-- Logs begin at Tue 2022-10-04 07:54:19 UTC, end at Tue 2022-10-04 08:51:06 UTC. -- Oct 04 08:19:48.221537 dv-cinder-860209-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 08:19:48.229389 dv-cinder-860209-1-smb devstack@keystone.service[81388]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 08:19:48 2022] *** Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: nodename: dv-cinder-860209-1-smb Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: machine: x86_64 Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: clock source: unix Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: pcre jit disabled Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: detected number of CPU cores: 4 Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: current working directory: / Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: detected binary path: /usr/bin/uwsgi-core Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: your processes number limit is 47680 Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: your memory page size is 4096 bytes Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: detected max file descriptor number: 2048 Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: lock engine: pthread robust mutexes Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: thunder lock: enabled Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 08:19:48.234695 dv-cinder-860209-1-smb devstack@keystone.service[81388]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 08:19:48.271849 dv-cinder-860209-1-smb devstack@keystone.service[81388]: Python main interpreter initialized at 0x55ab1e31d9c0 Oct 04 08:19:48.271849 dv-cinder-860209-1-smb devstack@keystone.service[81388]: python threads support enabled Oct 04 08:19:48.271849 dv-cinder-860209-1-smb devstack@keystone.service[81388]: your server socket listen backlog is limited to 100 connections Oct 04 08:19:48.271849 dv-cinder-860209-1-smb devstack@keystone.service[81388]: your mercy for graceful operations on workers is 90 seconds Oct 04 08:19:48.272249 dv-cinder-860209-1-smb devstack@keystone.service[81388]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 08:19:48.272336 dv-cinder-860209-1-smb devstack@keystone.service[81388]: *** Operational MODE: preforking *** Oct 04 08:19:48.272575 dv-cinder-860209-1-smb devstack@keystone.service[81388]: *** uWSGI is running in multiple interpreter mode *** Oct 04 08:19:48.272575 dv-cinder-860209-1-smb devstack@keystone.service[81388]: spawned uWSGI master process (pid: 81388) Oct 04 08:19:48.272784 dv-cinder-860209-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 04 08:19:48.274459 dv-cinder-860209-1-smb devstack@keystone.service[81388]: spawned uWSGI worker 1 (pid: 81398, cores: 1) Oct 04 08:19:48.275576 dv-cinder-860209-1-smb devstack@keystone.service[81388]: spawned uWSGI worker 2 (pid: 81399, cores: 1) Oct 04 08:19:48.275576 dv-cinder-860209-1-smb devstack@keystone.service[81388]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 08:19:52.578086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:19:52.578086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: from cryptography.utils import int_from_bytes Oct 04 08:19:52.578892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:19:52.578892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: from cryptography.utils import int_from_bytes Oct 04 08:19:52.584146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:19:52.584146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: from cryptography.utils import int_from_bytes Oct 04 08:19:52.584622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:19:52.584622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: from cryptography.utils import int_from_bytes Oct 04 08:19:52.629112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:19:52.629289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:19:52.629476 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] command line args: [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:19:52.629746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:19:52.629921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ================================================================================ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:19:52.630173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] admin_token = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.630420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_dir = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.630606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.630810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_source = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.630989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] debug = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.631185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.631559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.631738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.631989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.632236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.632491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.632676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_config_append = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.632854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.632976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:19:52.633076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_dir = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.633177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:19:52.633280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.633396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] command line args: [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:19:52.633512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.633632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:19:52.633714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.633831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ================================================================================ {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:19:52.633913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.634036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] admin_token = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.634113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.634237 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] config_dir = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.634319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.634442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.634518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.634642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] config_source = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.634764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.634892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] debug = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.634892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.635127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.635252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.635334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.635450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.635525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.635644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.635728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.635801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.635916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.635992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.636105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.636180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_config_append = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.636304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.636380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.636500 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_dir = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.636575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.636691 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_file = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.636870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.637010 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.637096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.637169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] publish_errors = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.637313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.637391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.637559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.637649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.637779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.637857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.637978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.638105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.638226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.638303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.638380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.638459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] standard_threads = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.638583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.638696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.638839 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.638932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.639057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.639177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.639252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_journal = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.639332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.639404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_json = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.639526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.639623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_stderr = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.639706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_syslog = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.639783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.639933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.640017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.640188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.640425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.640513 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.640679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] publish_errors = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.640756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.640914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.641048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.641148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.641226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.641326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.641410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.641574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.641659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.641807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.641887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.642042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] standard_threads = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.642119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.642274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.642363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.642518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.642596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.642714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.642807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.642881 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] use_journal = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.643019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.643099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] use_json = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.643222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] use_stderr = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.643300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.643399 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] use_syslog = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.643482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.643636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:19:52.643716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.643894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.644027 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.644154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.644281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.644413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.644544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.644667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.644792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.644922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.645054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.645187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.645323 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.645400 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.645471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.645542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.645611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.645756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.645843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.646003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.646081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.646250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.646328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.646477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.646550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.646718 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.646843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.646969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.647069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.647215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.647294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.647441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.647520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.647670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.647755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.647915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.648000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.648735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.648870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.648990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.649082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.649212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.649340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.649446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.649604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.649682 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.649871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.649960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.650123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.650202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.650354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.650439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.650584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.650663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.650837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.650926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.651067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.651145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.651306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.651386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.651537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.651614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.651773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.651851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.652004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.652084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.652232 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.652310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.652465 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.652541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.652711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.652799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.652941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.653020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.653178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.653256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.653408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.653487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.653643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.653726 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.653881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.653959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.654114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.654193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.654339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.654415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.654567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.654643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.654822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.654903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.655060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.655144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.655308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.655386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.655541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.655631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.655780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.655879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.655997 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.656103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.656236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.656342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.656471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.656576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.656716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.656827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.656940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.657072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.657158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.657276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.657398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.657488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.657634 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.657726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.657867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.657946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.658102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.658183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.658330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.658421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.658574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.658652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.658829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.658950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.659066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.659155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.659297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.659377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.659541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.659623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.659776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.659904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.659989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.660105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.660230 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.660316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.660461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.660551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.660693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.660773 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.660953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.661033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.661188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.661277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.661433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.661518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.661673 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.661753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.661907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.661996 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.662142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.662224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.662376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.662453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.662612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.662736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.662874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.662953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.663102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.663180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.663332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.663427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.663560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.663640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.664380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.664646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.664727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.664916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.664988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.665192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.665282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.665401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.665481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.665673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.665814 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.665941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.666070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.666213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.666341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.666474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.666607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.666792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.666916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.external = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.667041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.667175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.667306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.667445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.667572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.667696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.667819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.667954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.password = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.668078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.668210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.token = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.668335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.668461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.668587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.668719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.668843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.668997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.669131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.669267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.669393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.669517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.669643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.669778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.669908 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.670044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.670169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.670295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.670435 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.670561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.670709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.670843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.670970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.671095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.671219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.671348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.671474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.external = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.671619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.671746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.671870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.671993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.672118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.672241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.672372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.672503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.password = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.672638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.672764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] auth.token = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.672888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.673016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.673148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.673283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.673408 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.673532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.673659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.673785 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.673921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.674052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.674183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.674571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.674712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.674835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.674972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.675098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.675222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.675357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.675481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.675607 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.675695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.675770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.675842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.675978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.676995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677235 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677306 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677682 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.677988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.678067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.678202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.678283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.678451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.678531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.678743 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.678851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.678970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.679052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.679169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.679245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.679423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.679661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.679661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.679859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.679951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.680036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.680122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.680198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.680366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.680453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.680603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.680686 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.680852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.680937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.681087 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.681168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.681320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.681402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.681554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.681637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.681784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.681864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.682019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.682101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.682257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.682340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.682493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.682574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.682762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.682847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.682998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.683083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.683229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.683309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.683465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.683547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.683698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.683780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.683944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.684025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.684188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.684271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.684419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.684502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.684656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.684737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.684885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.684966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.685124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.685208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.685361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.685443 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.685606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.685759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.685898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.686025 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.686152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.686280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.686407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.686533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.686687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.686829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.686957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.687084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.687222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.687350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.687486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.687612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.687739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.687865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.687991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.688125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.688253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.688379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.688505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.688631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.688756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.688889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.689028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.689172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.689305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.689435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.689561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.689693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.689820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.689946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.690071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.690197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.690323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.690457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.690583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.690744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.690880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.691007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.691131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.691271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.691398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.691523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.691650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.691774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.691898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.692029 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.692156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.692281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.692405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.692542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.692668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.692802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.692927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.693052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.693176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.693300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.693424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.693558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.693684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.693810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.693935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.694060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.694186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.694327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.694453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.694580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.694580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.694827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.694952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.695157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.695289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.695417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.695586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.695737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.695737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.695984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.696121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.696246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.696370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.696494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.696620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.696760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.696760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.697000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.697125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.697249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.697373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.697506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.697631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.697758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.697893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.698018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.698144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.698276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.698403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.698530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.698655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.698807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.698936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.699072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.699199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.699323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.699448 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.699573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.699708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.699846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.699973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.700097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.700221 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.700345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.700471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.700602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.700728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.700853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.700979 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.701105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.701231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.701365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.701500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.701624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.701751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.701875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.702003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.702137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.702263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.702387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.702513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.702640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.702890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.703015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.703143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.703280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.703405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.703529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.703663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.703788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.703914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.704040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.704167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.704293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.704427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.704554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.704680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.704806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.704932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.705068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.705068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.705316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.705441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.705567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.705693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] role.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.705814 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.705953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] role.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.706080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.706207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.706333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.706459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.706583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.706745 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.706879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.707005 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.707128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.707252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.707380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.707511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.707636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.707762 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.707885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.708011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.708134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.708266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.708404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.708532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.708659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.708786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.708908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.709043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.709167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.709292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.709415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.709543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.709678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.709678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.709913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.710045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.710173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.710297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.710428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.710551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.711222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.711370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.711540 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.711688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.711869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.712001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.712128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.712254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.712379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.712520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.712653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.712781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.712907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.713035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.713158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.713285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.713419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.713547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.713673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.713798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.713923 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.714050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.714191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.714317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.714442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.714569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.714724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.714859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.714987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.715122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.715249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.715249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.715486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.715613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.715740 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.715879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.716015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.716143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.716270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.716270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.716507 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.716646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.716769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.716895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.717021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.717149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.717275 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.717409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.717536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.717663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.717746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.717915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.718049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.718182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.718307 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.718432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.718555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.718822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.718950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.719088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.719215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.719339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.719464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.719598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.719742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.719869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.719993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.connection = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:19:52.720501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.720501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.721538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.721538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.721538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.721538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.721538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.721538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.721538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.721538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.721538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:19:52.722557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:19:52.746546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.746805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.747031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.749387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.749623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.749851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.755359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.759006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.783776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.784002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.785021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.785260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.838021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.838635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.886742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.886967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.888081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:52.888318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.043594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.043767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.043959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.044180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.044399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.044484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.044614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.044698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.044853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.045076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.045296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.045514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.067789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.067971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.068065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.068262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.068349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.068497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.068581 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.068715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.068807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.068932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.069017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.069146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.069229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.069369 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.080969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.081244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.094110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.094338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.094468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.094570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.094728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.094816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.094964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.095049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.095193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.095279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.095404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.095487 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.095622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.095842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:19:53.112154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.112370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:19:53.112456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.112586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:19:53.112711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.112912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:19:53.112997 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.113119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:19:53.113201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.113396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.113488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.113662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.113744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.113925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.114008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.114189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.123523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.123802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.124032 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.124117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.124319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.124414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.124598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.124885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.131264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.131843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.134692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.134990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.135274 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.135358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.135558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.135642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.135844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.135929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.136108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.136193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.136381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.136474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.136655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.136738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.136927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.137012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.137202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.137287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.137471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.137604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.137764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.138038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.160503 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.161235 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.161950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.162238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.162725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.163018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.167200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.167491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.167774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.167856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.168066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.168353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.174028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.174582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.174929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.175222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.180221 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.180520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.180809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.180893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.181095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.181193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.181373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.181458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.181649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.181732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.181924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.182009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.182197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.182281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.182493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.182797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.198052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.198330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.198750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.199037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.202121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.202853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.205313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.205611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.206034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.206336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.209727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.210476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.213456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.214114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.216605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.216908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.217193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.217310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.217478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.217613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.217758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.217901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.218042 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.218191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.218473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.218787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.234444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.234573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.234811 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.234900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.235026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.235125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.235249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.235391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.242159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.242608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.243741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.244197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.245264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.245545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.245713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.245993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.248221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.248507 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.248656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.248796 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.248941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.249106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.249248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.249509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.249678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.249908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.261156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.261442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.261592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.262371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.262459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.262553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.262633 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.262738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.262816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.262892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.262980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.263059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.263134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.263349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.279108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.279218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.281987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.282079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.284859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.284960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.286292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.286379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.287773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.287996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.288080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.288285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.288450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.288696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.294853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.295371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.296250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.296823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.299117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.299783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.299994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.300079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.300331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.300427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.300685 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.300971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.308165 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.308458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.308741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.308863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.309162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.309451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.315595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.315883 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.316174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.316369 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:19:53.316454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.316672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.316755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.316961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.317057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.317238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.317322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.317515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.317608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.317791 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.317884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.318073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.318167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.318357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.318440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.318646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.318752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.318948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.319044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.319236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.319319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.319515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.319785 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.320648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:19:53.354058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab1e31d9c0 pid: 81398 (default app) Oct 04 08:19:53.355964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab1e31d9c0 pid: 81399 (default app) Oct 04 08:19:53.357391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6792b8-d51f-4f96-9309-702772fb8c71 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:19:53.357679 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6792b8-d51f-4f96-9309-702772fb8c71 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:19:53.357951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6792b8-d51f-4f96-9309-702772fb8c71 None None] PATH_INFO: `/v3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:19:53.362086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Tue Oct 4 08:19:53 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:00.147981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491efdcc-8f89-41c6-803e-125edbea16e4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:00.149014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491efdcc-8f89-41c6-803e-125edbea16e4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:00.149122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491efdcc-8f89-41c6-803e-125edbea16e4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:00.153335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:00.158735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:00.159174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:00.159317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:00.229515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: INFO dbcounter [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] Registered counter for database keystone Oct 04 08:20:00.248101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG oslo_db.sqlalchemy.engines [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:20:00.254229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writer thread running {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:20:00.435175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG passlib.handlers.bcrypt [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81398) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 08:20:00.435597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG passlib.handlers.bcrypt [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81398) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 08:20:00.496139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:00.497776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:00.627014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 08:20:01.081795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491efdcc-8f89-41c6-803e-125edbea16e4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:01.151690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: INFO dbcounter [None req-491efdcc-8f89-41c6-803e-125edbea16e4 None None] Registered counter for database keystone Oct 04 08:20:01.172838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG oslo_db.sqlalchemy.engines [None req-491efdcc-8f89-41c6-803e-125edbea16e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:20:01.179156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writer thread running {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:20:01.297546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491efdcc-8f89-41c6-803e-125edbea16e4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:01.302367 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937b4c3-1cce-499c-bf6a-19c6593ce275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:01.303057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b4c3-1cce-499c-bf6a-19c6593ce275 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:01.303344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b4c3-1cce-499c-bf6a-19c6593ce275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:01.303619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b4c3-1cce-499c-bf6a-19c6593ce275 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:01.312633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937b4c3-1cce-499c-bf6a-19c6593ce275 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:01.363039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7937b4c3-1cce-499c-bf6a-19c6593ce275 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 08:20:01.363238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937b4c3-1cce-499c-bf6a-19c6593ce275 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:01.373576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Oct 4 08:20:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:20:01.379505 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:01.396246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1be45-ac40-4a8d-85d0-05b8fca39481 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:01.400756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5eca3-7dc1-4d52-85d1-6d5a7f1169cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:01.401858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5eca3-7dc1-4d52-85d1-6d5a7f1169cf admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:01.402140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5eca3-7dc1-4d52-85d1-6d5a7f1169cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:01.402410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5eca3-7dc1-4d52-85d1-6d5a7f1169cf admin admin] PATH_INFO: `/v3/projects/9e3a02aac0ea474388632672a0c54b89` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:01.404015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5eca3-7dc1-4d52-85d1-6d5a7f1169cf admin admin] RBAC: Authorizing `identity:get_project(project_id=9e3a02aac0ea474388632672a0c54b89)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:01.456907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: WARNING keystone.common.rbac_enforcer.enforcer [None req-49d5eca3-7dc1-4d52-85d1-6d5a7f1169cf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 08:20:01.457268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5eca3-7dc1-4d52-85d1-6d5a7f1169cf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:01.461918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Tue Oct 4 08:20:01 2022] GET /identity/v3/projects/9e3a02aac0ea474388632672a0c54b89 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:03.569066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c21df-ff98-4981-b19c-df0fb339ebe6 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:03.569581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c21df-ff98-4981-b19c-df0fb339ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:03.569756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c21df-ff98-4981-b19c-df0fb339ebe6 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:03.574821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:03.580313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7e84f-0427-4fd2-8a77-c6589d3d04f5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:03.580716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7e84f-0427-4fd2-8a77-c6589d3d04f5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:03.580870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7e84f-0427-4fd2-8a77-c6589d3d04f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:03.601197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-29b7e84f-0427-4fd2-8a77-c6589d3d04f5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:03.602851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-29b7e84f-0427-4fd2-8a77-c6589d3d04f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:03.610526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 08:20:03.876917 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c21df-ff98-4981-b19c-df0fb339ebe6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:03.889298 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c21df-ff98-4981-b19c-df0fb339ebe6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:03.893456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eca0d4-e4a9-46b0-b0b7-7df6b78db5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:03.894046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eca0d4-e4a9-46b0-b0b7-7df6b78db5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:03.894321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eca0d4-e4a9-46b0-b0b7-7df6b78db5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:03.894591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eca0d4-e4a9-46b0-b0b7-7df6b78db5c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:03.902102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eca0d4-e4a9-46b0-b0b7-7df6b78db5c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:03.903894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eca0d4-e4a9-46b0-b0b7-7df6b78db5c0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:03.912374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Oct 4 08:20:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:20:03.917613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7e84f-0427-4fd2-8a77-c6589d3d04f5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:03.926854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7e84f-0427-4fd2-8a77-c6589d3d04f5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:03.931776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c484a-52c8-4dd1-a01f-103dda896652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:03.932397 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c484a-52c8-4dd1-a01f-103dda896652 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:03.932679 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c484a-52c8-4dd1-a01f-103dda896652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:03.932956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c484a-52c8-4dd1-a01f-103dda896652 admin admin] PATH_INFO: `/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:03.934288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c484a-52c8-4dd1-a01f-103dda896652 admin admin] RBAC: Authorizing `identity:get_user(user_id=e9cbf2d8bf704c83aab7f97b0095bb79)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:03.936141 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c484a-52c8-4dd1-a01f-103dda896652 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:03.937651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Tue Oct 4 08:20:03 2022] GET /identity/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:06.175712 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba2ef-30b1-48d1-bc39-4c575c10363e None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:06.176250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba2ef-30b1-48d1-bc39-4c575c10363e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:06.176250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba2ef-30b1-48d1-bc39-4c575c10363e None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:06.177685 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:06.178280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffa570-7305-4997-816b-f5f12c4eafa8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:06.178697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffa570-7305-4997-816b-f5f12c4eafa8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:06.178931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffa570-7305-4997-816b-f5f12c4eafa8 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:06.180762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:06.183191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c537-d418-45c9-86ef-61e38d344fb4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:06.183481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c537-d418-45c9-86ef-61e38d344fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:06.183762 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c537-d418-45c9-86ef-61e38d344fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:06.185557 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584b157-3a65-410d-983a-7b1e40a51436 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:06.185838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584b157-3a65-410d-983a-7b1e40a51436 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:06.186112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584b157-3a65-410d-983a-7b1e40a51436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:06.204190 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7584b157-3a65-410d-983a-7b1e40a51436 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:06.205378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7584b157-3a65-410d-983a-7b1e40a51436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:06.225879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG passlib.handlers.bcrypt [None req-43f4c537-d418-45c9-86ef-61e38d344fb4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81399) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 08:20:06.226321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG passlib.handlers.bcrypt [None req-43f4c537-d418-45c9-86ef-61e38d344fb4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81399) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 08:20:06.275993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-43f4c537-d418-45c9-86ef-61e38d344fb4 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:06.277576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-43f4c537-d418-45c9-86ef-61e38d344fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:06.285384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 7/12] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:06.385902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 6/13] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:06.562172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584b157-3a65-410d-983a-7b1e40a51436 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:06.586841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:06.653608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c537-d418-45c9-86ef-61e38d344fb4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:06.669972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584b157-3a65-410d-983a-7b1e40a51436 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:06.704382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd76ff-5fb5-45b4-a863-937333dcc473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:06.705394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd76ff-5fb5-45b4-a863-937333dcc473 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:06.705687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd76ff-5fb5-45b4-a863-937333dcc473 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:06.705965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd76ff-5fb5-45b4-a863-937333dcc473 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:06.759066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c537-d418-45c9-86ef-61e38d344fb4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:06.761284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:06.778992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd76ff-5fb5-45b4-a863-937333dcc473 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:06.780491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd76ff-5fb5-45b4-a863-937333dcc473 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:06.796105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71377c9b-bbfb-4231-a43c-c0927cc5d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:06.797203 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71377c9b-bbfb-4231-a43c-c0927cc5d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:06.797486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71377c9b-bbfb-4231-a43c-c0927cc5d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:06.797761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71377c9b-bbfb-4231-a43c-c0927cc5d4e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:06.803673 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:06.810589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71377c9b-bbfb-4231-a43c-c0927cc5d4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-71377c9b-bbfb-4231-a43c-c0927cc5d4e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:06.819102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:06.820223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:06.821188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:06.826350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71377c9b-bbfb-4231-a43c-c0927cc5d4e7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:06.881141 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:06.886584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd76ff-5fb5-45b4-a863-937333dcc473 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:06.924310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71377c9b-bbfb-4231-a43c-c0927cc5d4e7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:06.956970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fce56-f74a-4d21-acf9-166a82677703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:06.957570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fce56-f74a-4d21-acf9-166a82677703 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:06.957842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fce56-f74a-4d21-acf9-166a82677703 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:06.958109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fce56-f74a-4d21-acf9-166a82677703 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:06.958815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fce56-f74a-4d21-acf9-166a82677703 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:06.959123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fce56-f74a-4d21-acf9-166a82677703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:06.961131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fce56-f74a-4d21-acf9-166a82677703 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:06.972951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:06.979455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fce56-f74a-4d21-acf9-166a82677703 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:06.983186 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd76ff-5fb5-45b4-a863-937333dcc473 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:07.004880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:07.005544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:07.018046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729810ba-1f80-4276-9ed3-2dd7b1d4afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:07.018895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729810ba-1f80-4276-9ed3-2dd7b1d4afee None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:07.019170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729810ba-1f80-4276-9ed3-2dd7b1d4afee None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:07.019436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729810ba-1f80-4276-9ed3-2dd7b1d4afee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:07.030211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729810ba-1f80-4276-9ed3-2dd7b1d4afee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:07.031710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729810ba-1f80-4276-9ed3-2dd7b1d4afee None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-729810ba-1f80-4276-9ed3-2dd7b1d4afee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:20:07.050508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:07.051586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:20:07.052398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:20:07.052398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:20:07.052398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:07.052398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:07.057575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729810ba-1f80-4276-9ed3-2dd7b1d4afee None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:07.085292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fce56-f74a-4d21-acf9-166a82677703 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:07.120266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304a702-210b-4cd4-bff8-c4dd2e2ffc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:07.120898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304a702-210b-4cd4-bff8-c4dd2e2ffc34 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:07.121175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304a702-210b-4cd4-bff8-c4dd2e2ffc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:07.121453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304a702-210b-4cd4-bff8-c4dd2e2ffc34 None admin] PATH_INFO: `/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:07.122958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304a702-210b-4cd4-bff8-c4dd2e2ffc34 None admin] RBAC: Authorizing `identity:get_user(user_id=e9cbf2d8bf704c83aab7f97b0095bb79)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:07.124412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304a702-210b-4cd4-bff8-c4dd2e2ffc34 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:07.126279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:06 2022] GET /identity/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:07.131471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304a702-210b-4cd4-bff8-c4dd2e2ffc34 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:07.161194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729810ba-1f80-4276-9ed3-2dd7b1d4afee None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:07.195520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027735a-4528-47ab-afa8-ada3c2dc28bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:07.196173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027735a-4528-47ab-afa8-ada3c2dc28bd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:07.196441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027735a-4528-47ab-afa8-ada3c2dc28bd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:07.196717 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027735a-4528-47ab-afa8-ada3c2dc28bd None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:07.197359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027735a-4528-47ab-afa8-ada3c2dc28bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:07.197666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027735a-4528-47ab-afa8-ada3c2dc28bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:07.199101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027735a-4528-47ab-afa8-ada3c2dc28bd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:07.217519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:07.224224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:07.232444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304a702-210b-4cd4-bff8-c4dd2e2ffc34 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:07.268750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffe241-9b15-4d32-a1a3-bcdc1ba3fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:07.269315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe241-9b15-4d32-a1a3-bcdc1ba3fba0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:07.269599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe241-9b15-4d32-a1a3-bcdc1ba3fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:07.269873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe241-9b15-4d32-a1a3-bcdc1ba3fba0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:07.271127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffe241-9b15-4d32-a1a3-bcdc1ba3fba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:07.272631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffe241-9b15-4d32-a1a3-bcdc1ba3fba0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:07.274884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:07.281216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027735a-4528-47ab-afa8-ada3c2dc28bd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:07.318041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:07.393150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027735a-4528-47ab-afa8-ada3c2dc28bd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:07.427531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b7219-bcf7-41e5-9ced-af724fd3f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:07.428146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b7219-bcf7-41e5-9ced-af724fd3f547 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:07.428436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b7219-bcf7-41e5-9ced-af724fd3f547 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:07.428710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b7219-bcf7-41e5-9ced-af724fd3f547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:07.429988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b7219-bcf7-41e5-9ced-af724fd3f547 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.domain.id=default, user.id=e9cbf2d8bf704c83aab7f97b0095bb79) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:07.430307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b7219-bcf7-41e5-9ced-af724fd3f547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:07.431809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b7219-bcf7-41e5-9ced-af724fd3f547 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:07.439152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1322 bytes} [Tue Oct 4 08:20:07 2022] GET /identity/v3/role_assignments?user.id=e9cbf2d8bf704c83aab7f97b0095bb79&scope.domain.id=default&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:09.618710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95c832-fcc0-4d02-9ab0-a4b146ab6d2c None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:09.619659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95c832-fcc0-4d02-9ab0-a4b146ab6d2c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:09.620144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95c832-fcc0-4d02-9ab0-a4b146ab6d2c None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:09.621964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:09.627008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35ec0-3ef7-4c82-8876-98ed150f3a70 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:09.627405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35ec0-3ef7-4c82-8876-98ed150f3a70 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:09.627564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35ec0-3ef7-4c82-8876-98ed150f3a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:09.652770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8ed35ec0-3ef7-4c82-8876-98ed150f3a70 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:09.653969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8ed35ec0-3ef7-4c82-8876-98ed150f3a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:09.750533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:10.022239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dba3b-20f5-462a-bebb-2b1a19db2cec None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:10.022239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dba3b-20f5-462a-bebb-2b1a19db2cec None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:10.022239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dba3b-20f5-462a-bebb-2b1a19db2cec None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:10.023567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:10.036631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd5ef-4a84-4924-9377-ec40e4ba38e1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:10.036970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd5ef-4a84-4924-9377-ec40e4ba38e1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:10.037196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd5ef-4a84-4924-9377-ec40e4ba38e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:10.067822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a86bd5ef-4a84-4924-9377-ec40e4ba38e1 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:10.069026 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a86bd5ef-4a84-4924-9377-ec40e4ba38e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:10.097293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:10.146196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee99df-6d55-4c03-a7a6-ebb342e3b1f1 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:10.146769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee99df-6d55-4c03-a7a6-ebb342e3b1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:10.147234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee99df-6d55-4c03-a7a6-ebb342e3b1f1 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:10.149735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:10.154294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49ad7-0515-4669-ba2f-22d5be7b0b93 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:10.154833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49ad7-0515-4669-ba2f-22d5be7b0b93 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:10.155331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49ad7-0515-4669-ba2f-22d5be7b0b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:10.156907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:10.191729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4dd49ad7-0515-4669-ba2f-22d5be7b0b93 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:10.193204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4dd49ad7-0515-4669-ba2f-22d5be7b0b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:10.268559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bd5ef-4a84-4924-9377-ec40e4ba38e1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:10.269697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:10.425664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bd5ef-4a84-4924-9377-ec40e4ba38e1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:10.470959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec9929-1099-4c99-a886-1843428a5264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:10.471607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9929-1099-4c99-a886-1843428a5264 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:10.471891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9929-1099-4c99-a886-1843428a5264 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:10.472164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9929-1099-4c99-a886-1843428a5264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:10.483322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec9929-1099-4c99-a886-1843428a5264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:10.484808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec9929-1099-4c99-a886-1843428a5264 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a5ec9929-1099-4c99-a886-1843428a5264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:20:10.500500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:10.501391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:20:10.502194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:20:10.502194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:20:10.502194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:10.502194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 14/28] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:10.507724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd49ad7-0515-4669-ba2f-22d5be7b0b93 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:10.584922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec9929-1099-4c99-a886-1843428a5264 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:10.611769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:10.620592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:10.637113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd49ad7-0515-4669-ba2f-22d5be7b0b93 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:10.706389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ddc39-f196-4691-9f21-fddae7becc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:10.707284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ddc39-f196-4691-9f21-fddae7becc75 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:10.707897 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ddc39-f196-4691-9f21-fddae7becc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:10.709422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ddc39-f196-4691-9f21-fddae7becc75 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:10.710208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ddc39-f196-4691-9f21-fddae7becc75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:10.711038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ddc39-f196-4691-9f21-fddae7becc75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:10.713400 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ddc39-f196-4691-9f21-fddae7becc75 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:10.752251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 15/29] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:10.754120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ddc39-f196-4691-9f21-fddae7becc75 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:10.798181 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec9929-1099-4c99-a886-1843428a5264 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:10.848580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bb0f3-b7db-4bfc-b0d4-6198818a53fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:10.850230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bb0f3-b7db-4bfc-b0d4-6198818a53fe None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:10.850707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bb0f3-b7db-4bfc-b0d4-6198818a53fe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:10.851166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bb0f3-b7db-4bfc-b0d4-6198818a53fe None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:10.852175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bb0f3-b7db-4bfc-b0d4-6198818a53fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:10.853706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bb0f3-b7db-4bfc-b0d4-6198818a53fe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:10.881443 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ddc39-f196-4691-9f21-fddae7becc75 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:10.919645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512ab16-edcf-46aa-b376-68341964c04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:10.920524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512ab16-edcf-46aa-b376-68341964c04b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:10.920989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512ab16-edcf-46aa-b376-68341964c04b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:10.921396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512ab16-edcf-46aa-b376-68341964c04b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:10.933170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512ab16-edcf-46aa-b376-68341964c04b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-f512ab16-edcf-46aa-b376-68341964c04b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:10.941125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:10.942143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:10.943072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:10.944915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 16/30] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:20:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:10.950709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512ab16-edcf-46aa-b376-68341964c04b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:10.967220 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:11.010854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 15/31] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Oct 4 08:20:10 2022] POST /identity/v3/roles => generated 225 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:20:11.012664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f025-1842-4034-a11f-9441529e9543 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:11.012954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f025-1842-4034-a11f-9441529e9543 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:11.013660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f025-1842-4034-a11f-9441529e9543 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:11.018771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 16/32] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:11.020063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8f025-1842-4034-a11f-9441529e9543 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:11.066978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512ab16-edcf-46aa-b376-68341964c04b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:11.107411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85cdc5-6219-4640-8b12-eafd943b94c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:11.108069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85cdc5-6219-4640-8b12-eafd943b94c6 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:11.108350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85cdc5-6219-4640-8b12-eafd943b94c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:11.108619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85cdc5-6219-4640-8b12-eafd943b94c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:11.109380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85cdc5-6219-4640-8b12-eafd943b94c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:11.111565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85cdc5-6219-4640-8b12-eafd943b94c6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:11.127865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:11.170012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8f025-1842-4034-a11f-9441529e9543 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:11.215853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026516b-1f34-441f-9f95-7dbcbdc94e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:11.216912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026516b-1f34-441f-9f95-7dbcbdc94e98 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:11.217449 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026516b-1f34-441f-9f95-7dbcbdc94e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:11.217917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026516b-1f34-441f-9f95-7dbcbdc94e98 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:11.218858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026516b-1f34-441f-9f95-7dbcbdc94e98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:11.219376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026516b-1f34-441f-9f95-7dbcbdc94e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:11.221173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026516b-1f34-441f-9f95-7dbcbdc94e98 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:11.235797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:11.237499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3caf25-2dc7-4249-a3a4-34275c2d80d0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:11.237990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3caf25-2dc7-4249-a3a4-34275c2d80d0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:11.238487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3caf25-2dc7-4249-a3a4-34275c2d80d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:11.259449 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dc3caf25-2dc7-4249-a3a4-34275c2d80d0 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:11.261351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dc3caf25-2dc7-4249-a3a4-34275c2d80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:11.360223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 18/34] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:11.361471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3caf25-2dc7-4249-a3a4-34275c2d80d0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:11.380475 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 17/35] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:20:10 2022] POST /identity/v3/projects => generated 301 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:11.433387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:11.478040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3caf25-2dc7-4249-a3a4-34275c2d80d0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:11.515307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d24b5-3ba2-49a2-8417-7219ef5c35da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:11.515960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d24b5-3ba2-49a2-8417-7219ef5c35da None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:11.516242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d24b5-3ba2-49a2-8417-7219ef5c35da None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:11.516515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d24b5-3ba2-49a2-8417-7219ef5c35da None admin] PATH_INFO: `/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:11.517699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d24b5-3ba2-49a2-8417-7219ef5c35da None admin] RBAC: Authorizing `identity:get_user(user_id=e9cbf2d8bf704c83aab7f97b0095bb79)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:11.519203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d24b5-3ba2-49a2-8417-7219ef5c35da None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:11.521028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 19/36] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:11 2022] GET /identity/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:11.526836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85cdc5-6219-4640-8b12-eafd943b94c6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:11.607740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:11.657404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85cdc5-6219-4640-8b12-eafd943b94c6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:11.672520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d24b5-3ba2-49a2-8417-7219ef5c35da None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:11.701340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06087a-5aa0-4a6d-89e5-b59a6a52e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:11.701999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06087a-5aa0-4a6d-89e5-b59a6a52e2ae None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:11.702281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06087a-5aa0-4a6d-89e5-b59a6a52e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:11.702555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06087a-5aa0-4a6d-89e5-b59a6a52e2ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:11.703858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06087a-5aa0-4a6d-89e5-b59a6a52e2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:11.706247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06087a-5aa0-4a6d-89e5-b59a6a52e2ae None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:11.710198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 18/37] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:11.710362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a567a-874e-4719-85b7-e0b9001c6e5e None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:11.710598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a567a-874e-4719-85b7-e0b9001c6e5e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:11.710886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a567a-874e-4719-85b7-e0b9001c6e5e None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:11.712426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 19/38] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:11.718260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62131e88-e1a4-4f83-adae-737fe9b32c37 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:11.718548 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62131e88-e1a4-4f83-adae-737fe9b32c37 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:11.718925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62131e88-e1a4-4f83-adae-737fe9b32c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:11.746056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-62131e88-e1a4-4f83-adae-737fe9b32c37 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:11.748453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-62131e88-e1a4-4f83-adae-737fe9b32c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:11.833345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 20/39] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:11.834284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62131e88-e1a4-4f83-adae-737fe9b32c37 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:11.837216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d24b5-3ba2-49a2-8417-7219ef5c35da None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:11.905952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:11.949614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62131e88-e1a4-4f83-adae-737fe9b32c37 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:11.977825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:11.984891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13124f-ce65-4543-8b00-b804913dcf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:11.985514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13124f-ce65-4543-8b00-b804913dcf1d None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:11.985802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13124f-ce65-4543-8b00-b804913dcf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:11.986082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13124f-ce65-4543-8b00-b804913dcf1d None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:11.986800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13124f-ce65-4543-8b00-b804913dcf1d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:11.986909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b77e05-43d4-4848-98cf-f57e4c18f81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:11.987547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b77e05-43d4-4848-98cf-f57e4c18f81b None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:11.987831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b77e05-43d4-4848-98cf-f57e4c18f81b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:11.988108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b77e05-43d4-4848-98cf-f57e4c18f81b None admin] PATH_INFO: `/v3/domains/default/users/e9cbf2d8bf704c83aab7f97b0095bb79/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:11.988271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13124f-ce65-4543-8b00-b804913dcf1d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:11.990079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b77e05-43d4-4848-98cf-f57e4c18f81b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e9cbf2d8bf704c83aab7f97b0095bb79, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:11.991549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b77e05-43d4-4848-98cf-f57e4c18f81b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:12.014703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Oct 4 08:20:11 2022] POST /identity/v3/roles => generated 219 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:12.014703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e314-89f9-4504-93a0-9b34489be834 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:12.014703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e314-89f9-4504-93a0-9b34489be834 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:12.014703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e314-89f9-4504-93a0-9b34489be834 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:12.014703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 21/41] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:12.014703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed8de-a34e-47ea-9796-70a33555dea7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:12.014703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed8de-a34e-47ea-9796-70a33555dea7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:12.015261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed8de-a34e-47ea-9796-70a33555dea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:12.018852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1361 bytes} [Tue Oct 4 08:20:11 2022] PUT /identity/v3/domains/default/users/e9cbf2d8bf704c83aab7f97b0095bb79/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:20:12.037315 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b93ed8de-a34e-47ea-9796-70a33555dea7 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:12.038639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b93ed8de-a34e-47ea-9796-70a33555dea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:12.120021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b77e05-43d4-4848-98cf-f57e4c18f81b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:12.129974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 22/43] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:12.248001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b77e05-43d4-4848-98cf-f57e4c18f81b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:12.271492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:12.286082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b23a3-cfb4-472a-8881-fb7ff17d1364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:12.286766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b23a3-cfb4-472a-8881-fb7ff17d1364 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:12.287044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b23a3-cfb4-472a-8881-fb7ff17d1364 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:12.287319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b23a3-cfb4-472a-8881-fb7ff17d1364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:12.288421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b23a3-cfb4-472a-8881-fb7ff17d1364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:12.290496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b23a3-cfb4-472a-8881-fb7ff17d1364 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:12.292444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 22/44] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:12.298040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed8de-a34e-47ea-9796-70a33555dea7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:12.408184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed8de-a34e-47ea-9796-70a33555dea7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:12.408992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b23a3-cfb4-472a-8881-fb7ff17d1364 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:12.430789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:12.448421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b8db6-db87-4f26-a822-3aef92e68c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:12.449042 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b8db6-db87-4f26-a822-3aef92e68c58 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:12.449324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b8db6-db87-4f26-a822-3aef92e68c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:12.449598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b8db6-db87-4f26-a822-3aef92e68c58 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:12.450256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b8db6-db87-4f26-a822-3aef92e68c58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:12.453628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b8db6-db87-4f26-a822-3aef92e68c58 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:12.485214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:20:12 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:12.522566 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b23a3-cfb4-472a-8881-fb7ff17d1364 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:12.560895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82088a-d7c8-4ae9-ae0e-9521b45bfdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:12.561535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82088a-d7c8-4ae9-ae0e-9521b45bfdfa None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:12.562292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82088a-d7c8-4ae9-ae0e-9521b45bfdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:12.562292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82088a-d7c8-4ae9-ae0e-9521b45bfdfa None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:12.562826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82088a-d7c8-4ae9-ae0e-9521b45bfdfa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:12.564248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82088a-d7c8-4ae9-ae0e-9521b45bfdfa None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:12.581774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Oct 4 08:20:12 2022] POST /identity/v3/roles => generated 223 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:20:14.242063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9ac7-71a4-41f6-be13-427f99d87401 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:14.242638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9ac7-71a4-41f6-be13-427f99d87401 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:14.242638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9ac7-71a4-41f6-be13-427f99d87401 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:14.243966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:14.249185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8499168-7487-4c15-b53e-3eed8067d279 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:14.249577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8499168-7487-4c15-b53e-3eed8067d279 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:14.249738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8499168-7487-4c15-b53e-3eed8067d279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:14.267430 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c8499168-7487-4c15-b53e-3eed8067d279 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:14.268607 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c8499168-7487-4c15-b53e-3eed8067d279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:14.313857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:14.335136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:14.603995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df9ac7-71a4-41f6-be13-427f99d87401 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:14.667335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85f95-97b7-488c-ab56-26adb4cc1cea None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:14.667617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85f95-97b7-488c-ab56-26adb4cc1cea None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:14.667989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85f95-97b7-488c-ab56-26adb4cc1cea None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:14.669322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 25/49] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:14.674336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6096f1-371d-4705-9e3a-f478558de215 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:14.674626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6096f1-371d-4705-9e3a-f478558de215 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:14.675175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6096f1-371d-4705-9e3a-f478558de215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:14.692889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8e6096f1-371d-4705-9e3a-f478558de215 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:14.694066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8e6096f1-371d-4705-9e3a-f478558de215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:14.705929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df9ac7-71a4-41f6-be13-427f99d87401 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:14.738974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa9106-1c28-4c9e-92f1-d66796bc4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:14.739602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa9106-1c28-4c9e-92f1-d66796bc4ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:14.739886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa9106-1c28-4c9e-92f1-d66796bc4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:14.740159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa9106-1c28-4c9e-92f1-d66796bc4ff6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:14.752193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa9106-1c28-4c9e-92f1-d66796bc4ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:14.757993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 26/50] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-62aa9106-1c28-4c9e-92f1-d66796bc4ff6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:14.758336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:14.759398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:14.760157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 25/51] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:20:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:14.765046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6096f1-371d-4705-9e3a-f478558de215 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:14.859804 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6096f1-371d-4705-9e3a-f478558de215 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:14.869783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:14.892310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648141ca-2a67-437e-b1dc-722da075528c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:14.892914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648141ca-2a67-437e-b1dc-722da075528c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:14.893198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648141ca-2a67-437e-b1dc-722da075528c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:14.893478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648141ca-2a67-437e-b1dc-722da075528c None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:14.894140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648141ca-2a67-437e-b1dc-722da075528c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:14.894446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648141ca-2a67-437e-b1dc-722da075528c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:14.895880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648141ca-2a67-437e-b1dc-722da075528c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:14.904300 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 27/52] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:14.909930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa9106-1c28-4c9e-92f1-d66796bc4ff6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:14.940784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:15.009691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa9106-1c28-4c9e-92f1-d66796bc4ff6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:15.033328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648141ca-2a67-437e-b1dc-722da075528c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:15.045049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ef59a-5073-4be0-9aa4-b3210eed953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:15.045684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef59a-5073-4be0-9aa4-b3210eed953f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:15.045967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef59a-5073-4be0-9aa4-b3210eed953f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:15.046242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef59a-5073-4be0-9aa4-b3210eed953f None admin] PATH_INFO: `/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:15.047398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ef59a-5073-4be0-9aa4-b3210eed953f None admin] RBAC: Authorizing `identity:get_user(user_id=e9cbf2d8bf704c83aab7f97b0095bb79)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:15.048873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ef59a-5073-4be0-9aa4-b3210eed953f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:15.050726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:14 2022] GET /identity/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:15.056577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ef59a-5073-4be0-9aa4-b3210eed953f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:15.137218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648141ca-2a67-437e-b1dc-722da075528c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:15.154667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:15.157870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ef59a-5073-4be0-9aa4-b3210eed953f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:15.171445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e043f-53f4-4e47-a658-aea9f239df84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:15.172069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e043f-53f4-4e47-a658-aea9f239df84 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:15.172345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e043f-53f4-4e47-a658-aea9f239df84 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:15.172614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e043f-53f4-4e47-a658-aea9f239df84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:15.173706 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e043f-53f4-4e47-a658-aea9f239df84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:15.175460 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e043f-53f4-4e47-a658-aea9f239df84 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:15.177193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 28/54] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:15.182580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e043f-53f4-4e47-a658-aea9f239df84 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:15.192377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b79184-d027-4cf3-bf56-8a84a5642b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:15.193007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b79184-d027-4cf3-bf56-8a84a5642b72 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:15.193296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b79184-d027-4cf3-bf56-8a84a5642b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:15.193569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b79184-d027-4cf3-bf56-8a84a5642b72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:15.194689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b79184-d027-4cf3-bf56-8a84a5642b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:15.196781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b79184-d027-4cf3-bf56-8a84a5642b72 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:15.198335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:15.203966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b79184-d027-4cf3-bf56-8a84a5642b72 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:15.224306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:15.308801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b79184-d027-4cf3-bf56-8a84a5642b72 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:15.345256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a17bdc-5c19-44a1-ba47-87755b94b64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:15.345876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17bdc-5c19-44a1-ba47-87755b94b64d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:15.346161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17bdc-5c19-44a1-ba47-87755b94b64d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:15.346439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17bdc-5c19-44a1-ba47-87755b94b64d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:15.347214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a17bdc-5c19-44a1-ba47-87755b94b64d None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.domain.id=default, user.id=e9cbf2d8bf704c83aab7f97b0095bb79) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:15.347528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a17bdc-5c19-44a1-ba47-87755b94b64d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:15.349005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a17bdc-5c19-44a1-ba47-87755b94b64d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:15.355504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 28/56] 10.222.0.23 () {56 vars in 1322 bytes} [Tue Oct 4 08:20:15 2022] GET /identity/v3/role_assignments?user.id=e9cbf2d8bf704c83aab7f97b0095bb79&scope.domain.id=default&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:15.389187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e043f-53f4-4e47-a658-aea9f239df84 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:15.425441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef729ac-c1ef-4fab-84c4-c1031cd3d348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:15.426078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef729ac-c1ef-4fab-84c4-c1031cd3d348 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:15.426358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef729ac-c1ef-4fab-84c4-c1031cd3d348 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:15.426627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef729ac-c1ef-4fab-84c4-c1031cd3d348 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:15.427336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef729ac-c1ef-4fab-84c4-c1031cd3d348 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:15.428801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef729ac-c1ef-4fab-84c4-c1031cd3d348 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:15.457633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 29/57] 10.222.0.23 () {60 vars in 1140 bytes} [Tue Oct 4 08:20:15 2022] POST /identity/v3/projects => generated 298 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:20:17.629643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cab41-c64a-43b3-afe3-d234736acee9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:17.630157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cab41-c64a-43b3-afe3-d234736acee9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:17.630240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cab41-c64a-43b3-afe3-d234736acee9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:17.631569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 29/58] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:17.636830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dcebb-2a82-40b3-9bd2-9d21197d964b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:17.637193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dcebb-2a82-40b3-9bd2-9d21197d964b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:17.637426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dcebb-2a82-40b3-9bd2-9d21197d964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:17.654868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-873dcebb-2a82-40b3-9bd2-9d21197d964b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:17.656046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-873dcebb-2a82-40b3-9bd2-9d21197d964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:17.720688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:17.990124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cab41-c64a-43b3-afe3-d234736acee9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:18.020915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:18.090515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cab41-c64a-43b3-afe3-d234736acee9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:18.124531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8476cd0-5e61-4fda-ad0b-dfcd080c95dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:18.125156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476cd0-5e61-4fda-ad0b-dfcd080c95dd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:18.125441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476cd0-5e61-4fda-ad0b-dfcd080c95dd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:18.125718 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476cd0-5e61-4fda-ad0b-dfcd080c95dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:18.126932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8476cd0-5e61-4fda-ad0b-dfcd080c95dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:18.128373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8476cd0-5e61-4fda-ad0b-dfcd080c95dd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:18.129918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 30/60] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:18.136185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dcebb-2a82-40b3-9bd2-9d21197d964b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:18.159448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:18.232237 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dcebb-2a82-40b3-9bd2-9d21197d964b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:18.264492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a3048-6b3d-47fe-9332-1071c91d81c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:18.265040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3048-6b3d-47fe-9332-1071c91d81c0 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:18.265322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3048-6b3d-47fe-9332-1071c91d81c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:18.265600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3048-6b3d-47fe-9332-1071c91d81c0 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:18.266251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a3048-6b3d-47fe-9332-1071c91d81c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:18.267730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a3048-6b3d-47fe-9332-1071c91d81c0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:18.293185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 31/61] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:20:18 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:21.426088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868903c-89ca-41e7-a714-73ccf01ff416 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:21.426600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868903c-89ca-41e7-a714-73ccf01ff416 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:21.426692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868903c-89ca-41e7-a714-73ccf01ff416 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:21.428013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 31/62] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:21.439215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4b800-70c2-4d73-8c7f-cf59b11b0ec2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:21.439692 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4b800-70c2-4d73-8c7f-cf59b11b0ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:21.439765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4b800-70c2-4d73-8c7f-cf59b11b0ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:21.468267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-62d4b800-70c2-4d73-8c7f-cf59b11b0ec2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:21.470702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-62d4b800-70c2-4d73-8c7f-cf59b11b0ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:21.568975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:21.745734 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4801c0-cd71-43d6-a0ff-3c4fca1e8a8c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:21.746261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4801c0-cd71-43d6-a0ff-3c4fca1e8a8c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:21.746732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4801c0-cd71-43d6-a0ff-3c4fca1e8a8c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:21.748583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 32/64] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:21.753759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da4a0d-6248-455e-b31c-0ab8a932cb83 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:21.754049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da4a0d-6248-455e-b31c-0ab8a932cb83 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:21.754330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da4a0d-6248-455e-b31c-0ab8a932cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:21.782290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-54da4a0d-6248-455e-b31c-0ab8a932cb83 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:21.783524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-54da4a0d-6248-455e-b31c-0ab8a932cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:21.785622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:21.880038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:21.950283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4801c0-cd71-43d6-a0ff-3c4fca1e8a8c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:22.096692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:22.100463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4801c0-cd71-43d6-a0ff-3c4fca1e8a8c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:22.110951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac1fe8-7b32-4869-8ff3-3cd7fd758d72 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.111677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac1fe8-7b32-4869-8ff3-3cd7fd758d72 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.112153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac1fe8-7b32-4869-8ff3-3cd7fd758d72 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.113974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 34/66] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:22.119727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d28c13-20c2-43ec-977e-8ead0839cee5 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.120283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d28c13-20c2-43ec-977e-8ead0839cee5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.120895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d28c13-20c2-43ec-977e-8ead0839cee5 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.122475 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 35/67] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:22.124030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77f0d-7212-4bea-ab48-d59a3b75ad4b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.124616 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77f0d-7212-4bea-ab48-d59a3b75ad4b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.125126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77f0d-7212-4bea-ab48-d59a3b75ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.146919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-54d77f0d-7212-4bea-ab48-d59a3b75ad4b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:22.149467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-54d77f0d-7212-4bea-ab48-d59a3b75ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:22.150355 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee708655-d701-46dc-a9cf-53d583fa86cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:22.151044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708655-d701-46dc-a9cf-53d583fa86cc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.151388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708655-d701-46dc-a9cf-53d583fa86cc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.151679 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708655-d701-46dc-a9cf-53d583fa86cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.163209 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee708655-d701-46dc-a9cf-53d583fa86cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ee708655-d701-46dc-a9cf-53d583fa86cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:22.169764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:22.170687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:22.171474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 33/68] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:22.172714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2a443-5b22-46b2-8139-27e445baa945 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.172714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2a443-5b22-46b2-8139-27e445baa945 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.172714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2a443-5b22-46b2-8139-27e445baa945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.206403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eca2a443-5b22-46b2-8139-27e445baa945 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:22.208803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eca2a443-5b22-46b2-8139-27e445baa945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:22.232275 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 36/69] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:22.239976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d77f0d-7212-4bea-ab48-d59a3b75ad4b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:22.307518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 34/70] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:22.310155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2a443-5b22-46b2-8139-27e445baa945 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:22.335497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:22.383570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d77f0d-7212-4bea-ab48-d59a3b75ad4b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:22.419972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96fa83-ba4b-4c73-b927-7d445439964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:22.420827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96fa83-ba4b-4c73-b927-7d445439964e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.421269 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96fa83-ba4b-4c73-b927-7d445439964e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.421542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96fa83-ba4b-4c73-b927-7d445439964e None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.422349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96fa83-ba4b-4c73-b927-7d445439964e None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:22.422847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96fa83-ba4b-4c73-b927-7d445439964e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:22.424373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96fa83-ba4b-4c73-b927-7d445439964e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:22.436091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 37/71] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:22.437837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e3d8-9fd3-4621-9299-bec53e3e9d38 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.438327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e3d8-9fd3-4621-9299-bec53e3e9d38 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.438807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e3d8-9fd3-4621-9299-bec53e3e9d38 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.440555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 38/72] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:22.442324 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85e3d8-9fd3-4621-9299-bec53e3e9d38 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:22.459173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:22.471774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2a443-5b22-46b2-8139-27e445baa945 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:22.515882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e1a68-2419-4f75-9d0e-8affba7c8118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:22.517489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e1a68-2419-4f75-9d0e-8affba7c8118 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.517917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e1a68-2419-4f75-9d0e-8affba7c8118 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.518346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e1a68-2419-4f75-9d0e-8affba7c8118 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.533039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e1a68-2419-4f75-9d0e-8affba7c8118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-904e1a68-2419-4f75-9d0e-8affba7c8118 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:22.539366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:22.540378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:22.541325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:22.543905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 35/73] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:20:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:22.546430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2d11-2b05-4946-b886-772d50799c9b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.546902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2d11-2b05-4946-b886-772d50799c9b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.547307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2d11-2b05-4946-b886-772d50799c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.567240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7dae2d11-2b05-4946-b886-772d50799c9b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:22.568560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7dae2d11-2b05-4946-b886-772d50799c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:22.576316 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85e3d8-9fd3-4621-9299-bec53e3e9d38 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:22.606201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:22.612298 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b41f-7742-48db-877e-84d46febd979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:22.612929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b41f-7742-48db-877e-84d46febd979 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.613206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b41f-7742-48db-877e-84d46febd979 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.613477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b41f-7742-48db-877e-84d46febd979 None admin] PATH_INFO: `/v3/users/5b8bc8c97d8b42988e9534a42c6e4196` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.629398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2b41f-7742-48db-877e-84d46febd979 None admin] RBAC: Authorizing `identity:get_user(user_id=5b8bc8c97d8b42988e9534a42c6e4196)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:22.630876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2b41f-7742-48db-877e-84d46febd979 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:22.633255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 39/74] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:22 2022] GET /identity/v3/users/5b8bc8c97d8b42988e9534a42c6e4196 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:22.634148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b41f-7742-48db-877e-84d46febd979 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:22.658696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 36/75] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:22.658696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2d11-2b05-4946-b886-772d50799c9b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:22.743064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b41f-7742-48db-877e-84d46febd979 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:22.744491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:22.764335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2d11-2b05-4946-b886-772d50799c9b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:22.781167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9b861-6a64-4bd6-8126-dbffe4ae19c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:22.782099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9b861-6a64-4bd6-8126-dbffe4ae19c2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.782386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9b861-6a64-4bd6-8126-dbffe4ae19c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.782661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9b861-6a64-4bd6-8126-dbffe4ae19c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.793917 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9b861-6a64-4bd6-8126-dbffe4ae19c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b2c9b861-6a64-4bd6-8126-dbffe4ae19c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:22.798893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:22.799768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:22.800786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:22.801406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873afec-d080-4ec5-9b30-cdb7858a64e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:22.801406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873afec-d080-4ec5-9b30-cdb7858a64e7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.801539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 40/76] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:22.801604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873afec-d080-4ec5-9b30-cdb7858a64e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.801604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873afec-d080-4ec5-9b30-cdb7858a64e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.802614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9b861-6a64-4bd6-8126-dbffe4ae19c2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:22.802839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873afec-d080-4ec5-9b30-cdb7858a64e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:22.802839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873afec-d080-4ec5-9b30-cdb7858a64e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:22.808235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873afec-d080-4ec5-9b30-cdb7858a64e7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:22.822032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 37/77] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:22.822032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873afec-d080-4ec5-9b30-cdb7858a64e7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:22.858510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:22.917041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9b861-6a64-4bd6-8126-dbffe4ae19c2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:22.923104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873afec-d080-4ec5-9b30-cdb7858a64e7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:22.952343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446a55-cae8-4a6b-b33d-2dfc1d68445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:22.952973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446a55-cae8-4a6b-b33d-2dfc1d68445c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.953260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446a55-cae8-4a6b-b33d-2dfc1d68445c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.953525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446a55-cae8-4a6b-b33d-2dfc1d68445c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.957055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478dc7-c78a-4e2b-ba9c-bbddff4e6b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:22.957664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478dc7-c78a-4e2b-ba9c-bbddff4e6b4f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:22.957948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478dc7-c78a-4e2b-ba9c-bbddff4e6b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:22.958224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478dc7-c78a-4e2b-ba9c-bbddff4e6b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:22.964029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61446a55-cae8-4a6b-b33d-2dfc1d68445c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-61446a55-cae8-4a6b-b33d-2dfc1d68445c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:22.968846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:22.969696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:22.970491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 41/78] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:20:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:22.971181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446a55-cae8-4a6b-b33d-2dfc1d68445c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:22.973200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:23.027740 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5478dc7-c78a-4e2b-ba9c-bbddff4e6b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:23.029216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5478dc7-c78a-4e2b-ba9c-bbddff4e6b4f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:23.067167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446a55-cae8-4a6b-b33d-2dfc1d68445c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:23.076163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:23.100803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29581b4-d5f7-4fe0-917c-2d96d58fa4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:23.101473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29581b4-d5f7-4fe0-917c-2d96d58fa4ac None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:23.101752 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29581b4-d5f7-4fe0-917c-2d96d58fa4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:23.102023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29581b4-d5f7-4fe0-917c-2d96d58fa4ac None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:23.102706 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29581b4-d5f7-4fe0-917c-2d96d58fa4ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:23.103018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29581b4-d5f7-4fe0-917c-2d96d58fa4ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:23.104389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29581b4-d5f7-4fe0-917c-2d96d58fa4ac None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:23.112350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 42/79] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:23.113132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29581b4-d5f7-4fe0-917c-2d96d58fa4ac None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:23.134742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 38/80] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:23.134742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478dc7-c78a-4e2b-ba9c-bbddff4e6b4f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:23.172407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:23.212438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29581b4-d5f7-4fe0-917c-2d96d58fa4ac None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:23.228895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478dc7-c78a-4e2b-ba9c-bbddff4e6b4f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:23.244573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b21da0-c2c2-4ff7-b09b-556c95f62293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:23.245198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b21da0-c2c2-4ff7-b09b-556c95f62293 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:23.245476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b21da0-c2c2-4ff7-b09b-556c95f62293 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:23.245753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b21da0-c2c2-4ff7-b09b-556c95f62293 None admin] PATH_INFO: `/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:23.246895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b21da0-c2c2-4ff7-b09b-556c95f62293 None admin] RBAC: Authorizing `identity:get_user(user_id=e9cbf2d8bf704c83aab7f97b0095bb79)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:23.248339 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b21da0-c2c2-4ff7-b09b-556c95f62293 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:23.249892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 43/81] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:23 2022] GET /identity/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:23.250654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b21da0-c2c2-4ff7-b09b-556c95f62293 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:23.265356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380d131-c5d5-46b9-b068-3cacf58f294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:23.266275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380d131-c5d5-46b9-b068-3cacf58f294a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:23.266562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380d131-c5d5-46b9-b068-3cacf58f294a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:23.267133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380d131-c5d5-46b9-b068-3cacf58f294a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:23.268252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380d131-c5d5-46b9-b068-3cacf58f294a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:23.269717 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380d131-c5d5-46b9-b068-3cacf58f294a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:23.271463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 39/82] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:23.272185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380d131-c5d5-46b9-b068-3cacf58f294a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:23.288447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:23.348960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b21da0-c2c2-4ff7-b09b-556c95f62293 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:23.371699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380d131-c5d5-46b9-b068-3cacf58f294a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:23.383002 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724d594-482b-489c-92a2-0e53226c6b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:23.383617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724d594-482b-489c-92a2-0e53226c6b7d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:23.384133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724d594-482b-489c-92a2-0e53226c6b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:23.384243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:23.384340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724d594-482b-489c-92a2-0e53226c6b7d None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:23.384820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724d594-482b-489c-92a2-0e53226c6b7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:23.385124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724d594-482b-489c-92a2-0e53226c6b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:23.386519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724d594-482b-489c-92a2-0e53226c6b7d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:23.394658 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 44/83] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:20:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:23.395309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724d594-482b-489c-92a2-0e53226c6b7d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:23.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd2f2b-6102-45a9-aff2-b95f8fedf14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:23.409132 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd2f2b-6102-45a9-aff2-b95f8fedf14d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:23.409415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd2f2b-6102-45a9-aff2-b95f8fedf14d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:23.409689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd2f2b-6102-45a9-aff2-b95f8fedf14d None admin] PATH_INFO: `/v3/users/5b8bc8c97d8b42988e9534a42c6e4196` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:23.410844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd2f2b-6102-45a9-aff2-b95f8fedf14d None admin] RBAC: Authorizing `identity:get_user(user_id=5b8bc8c97d8b42988e9534a42c6e4196)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:23.412295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd2f2b-6102-45a9-aff2-b95f8fedf14d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:23.414390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 40/84] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:23 2022] GET /identity/v3/users/5b8bc8c97d8b42988e9534a42c6e4196 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:23.415166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd2f2b-6102-45a9-aff2-b95f8fedf14d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:23.498304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:23.501841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724d594-482b-489c-92a2-0e53226c6b7d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:23.516976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd2f2b-6102-45a9-aff2-b95f8fedf14d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:23.535146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc37f-1290-40fa-a7d6-1df493256c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:23.535776 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc37f-1290-40fa-a7d6-1df493256c0f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:23.536064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc37f-1290-40fa-a7d6-1df493256c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:23.536330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc37f-1290-40fa-a7d6-1df493256c0f None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:23.537453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc37f-1290-40fa-a7d6-1df493256c0f None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:23.539162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc37f-1290-40fa-a7d6-1df493256c0f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:23.540805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 45/85] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:23 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:23.540805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc37f-1290-40fa-a7d6-1df493256c0f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:23.553614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379f1d7-15fd-483c-bfbb-84cfd6e0ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:23.554253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379f1d7-15fd-483c-bfbb-84cfd6e0ef08 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:23.554569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379f1d7-15fd-483c-bfbb-84cfd6e0ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:23.554872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379f1d7-15fd-483c-bfbb-84cfd6e0ef08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:23.599993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:23.621785 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379f1d7-15fd-483c-bfbb-84cfd6e0ef08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:23.623300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379f1d7-15fd-483c-bfbb-84cfd6e0ef08 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:23.645887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc37f-1290-40fa-a7d6-1df493256c0f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:23.679114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bec4fa-7ec3-4e1a-8de5-898ee528d144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:23.679720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bec4fa-7ec3-4e1a-8de5-898ee528d144 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:23.680030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bec4fa-7ec3-4e1a-8de5-898ee528d144 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:23.680330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bec4fa-7ec3-4e1a-8de5-898ee528d144 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:23.680996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bec4fa-7ec3-4e1a-8de5-898ee528d144 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:23.682424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bec4fa-7ec3-4e1a-8de5-898ee528d144 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:23.703690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 46/86] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:20:23 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:23.704505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bec4fa-7ec3-4e1a-8de5-898ee528d144 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:23.735054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 41/87] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:23.736292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379f1d7-15fd-483c-bfbb-84cfd6e0ef08 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:23.745546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:23.825686 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:23.843434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bec4fa-7ec3-4e1a-8de5-898ee528d144 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:23.853614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379f1d7-15fd-483c-bfbb-84cfd6e0ef08 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:23.884265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921e0c1-4262-4d07-97bb-067b7026297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:23.885285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921e0c1-4262-4d07-97bb-067b7026297a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:23.885285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921e0c1-4262-4d07-97bb-067b7026297a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:23.885546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921e0c1-4262-4d07-97bb-067b7026297a None admin] PATH_INFO: `/v3/users/5b8bc8c97d8b42988e9534a42c6e4196` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:23.886837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921e0c1-4262-4d07-97bb-067b7026297a None admin] RBAC: Authorizing `identity:get_user(user_id=5b8bc8c97d8b42988e9534a42c6e4196)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:23.888321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921e0c1-4262-4d07-97bb-067b7026297a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:23.889954 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 47/88] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:23 2022] GET /identity/v3/users/5b8bc8c97d8b42988e9534a42c6e4196 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:23.891152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921e0c1-4262-4d07-97bb-067b7026297a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:23.912147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9338347-3c3d-4ece-a950-f02b373b09ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:23.912478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338347-3c3d-4ece-a950-f02b373b09ff None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:23.912966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338347-3c3d-4ece-a950-f02b373b09ff None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:23.913240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338347-3c3d-4ece-a950-f02b373b09ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:24.001977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:24.002905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9338347-3c3d-4ece-a950-f02b373b09ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:24.004653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9338347-3c3d-4ece-a950-f02b373b09ff None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:24.015683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921e0c1-4262-4d07-97bb-067b7026297a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:24.056001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998a0d3-4e65-4c07-bf8c-a6c64987fed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:24.056729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998a0d3-4e65-4c07-bf8c-a6c64987fed3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:24.057010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998a0d3-4e65-4c07-bf8c-a6c64987fed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:24.057285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998a0d3-4e65-4c07-bf8c-a6c64987fed3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:24.058025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998a0d3-4e65-4c07-bf8c-a6c64987fed3 None admin] RBAC: Adding query filter params (role.id=adb2774e1d254454a97fab85c6000155, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008, user.id=5b8bc8c97d8b42988e9534a42c6e4196) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:24.058345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998a0d3-4e65-4c07-bf8c-a6c64987fed3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:24.059838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998a0d3-4e65-4c07-bf8c-a6c64987fed3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:24.069279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 48/89] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:23 2022] GET /identity/v3/role_assignments?user.id=5b8bc8c97d8b42988e9534a42c6e4196&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=adb2774e1d254454a97fab85c6000155 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:24.070666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998a0d3-4e65-4c07-bf8c-a6c64987fed3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:24.097099 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:24.123911 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 42/90] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:24.124960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9338347-3c3d-4ece-a950-f02b373b09ff None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:24.222653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998a0d3-4e65-4c07-bf8c-a6c64987fed3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:24.243989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9338347-3c3d-4ece-a950-f02b373b09ff None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:24.288359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604eb96-5cd0-41fa-9f40-8d8eb9a0eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:24.289468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604eb96-5cd0-41fa-9f40-8d8eb9a0eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:24.289760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdab676-9e48-4026-8f37-c29247b2444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:24.290179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604eb96-5cd0-41fa-9f40-8d8eb9a0eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:24.290563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdab676-9e48-4026-8f37-c29247b2444c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:24.290841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604eb96-5cd0-41fa-9f40-8d8eb9a0eaa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:24.290939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdab676-9e48-4026-8f37-c29247b2444c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:24.291276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdab676-9e48-4026-8f37-c29247b2444c None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:24.295939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdab676-9e48-4026-8f37-c29247b2444c None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:24.297242 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdab676-9e48-4026-8f37-c29247b2444c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:24.299514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 49/91] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:24 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:24.300777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdab676-9e48-4026-8f37-c29247b2444c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:24.358651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:24.377204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:24.383936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604eb96-5cd0-41fa-9f40-8d8eb9a0eaa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:24.385569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604eb96-5cd0-41fa-9f40-8d8eb9a0eaa7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:24.517070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdab676-9e48-4026-8f37-c29247b2444c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:24.534848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 43/92] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:24.535553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604eb96-5cd0-41fa-9f40-8d8eb9a0eaa7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:24.593018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31e364-3ad3-4218-a8e0-bd06b8c81721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:24.593589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e364-3ad3-4218-a8e0-bd06b8c81721 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:24.593875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e364-3ad3-4218-a8e0-bd06b8c81721 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:24.594155 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e364-3ad3-4218-a8e0-bd06b8c81721 None admin] PATH_INFO: `/v3/projects/dade56232c384d2d9bbeb826e849e4bc` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:24.597416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31e364-3ad3-4218-a8e0-bd06b8c81721 None admin] RBAC: Authorizing `identity:get_project(project_id=dade56232c384d2d9bbeb826e849e4bc)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:24.598915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31e364-3ad3-4218-a8e0-bd06b8c81721 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:24.600615 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 50/93] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:24 2022] GET /identity/v3/projects/dade56232c384d2d9bbeb826e849e4bc => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:24.602120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31e364-3ad3-4218-a8e0-bd06b8c81721 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:24.707032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:24.740877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:24.752638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31e364-3ad3-4218-a8e0-bd06b8c81721 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:24.764844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604eb96-5cd0-41fa-9f40-8d8eb9a0eaa7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:24.793644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0ba33-e30c-4d53-9dcb-a72947ec11e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:24.794528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0ba33-e30c-4d53-9dcb-a72947ec11e2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:24.794980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0ba33-e30c-4d53-9dcb-a72947ec11e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:24.795578 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0ba33-e30c-4d53-9dcb-a72947ec11e2 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:24.796998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0ba33-e30c-4d53-9dcb-a72947ec11e2 None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:24.798653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0ba33-e30c-4d53-9dcb-a72947ec11e2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:24.801189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 51/94] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:24 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:24.802210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0ba33-e30c-4d53-9dcb-a72947ec11e2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:24.877422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab873d2-28eb-4e27-8a61-2d04467b9691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:24.878018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab873d2-28eb-4e27-8a61-2d04467b9691 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:24.878303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab873d2-28eb-4e27-8a61-2d04467b9691 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:24.878581 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab873d2-28eb-4e27-8a61-2d04467b9691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:24.879491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab873d2-28eb-4e27-8a61-2d04467b9691 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008, user.id=e9cbf2d8bf704c83aab7f97b0095bb79) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:24.879811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab873d2-28eb-4e27-8a61-2d04467b9691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:24.881431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab873d2-28eb-4e27-8a61-2d04467b9691 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:24.897173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 44/95] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:24 2022] GET /identity/v3/role_assignments?user.id=e9cbf2d8bf704c83aab7f97b0095bb79&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:24.899165 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab873d2-28eb-4e27-8a61-2d04467b9691 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:24.953971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0ba33-e30c-4d53-9dcb-a72947ec11e2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:24.992847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0714d83-9270-4e0c-891f-4ff9d4c31ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:24.993832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0714d83-9270-4e0c-891f-4ff9d4c31ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:24.994314 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0714d83-9270-4e0c-891f-4ff9d4c31ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:24.994819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0714d83-9270-4e0c-891f-4ff9d4c31ba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:24.995786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0714d83-9270-4e0c-891f-4ff9d4c31ba2 None admin] RBAC: Adding query filter params (role.id=adb2774e1d254454a97fab85c6000155, scope.project.id=dade56232c384d2d9bbeb826e849e4bc, user.id=5b8bc8c97d8b42988e9534a42c6e4196) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:24.996336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0714d83-9270-4e0c-891f-4ff9d4c31ba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:24.998080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0714d83-9270-4e0c-891f-4ff9d4c31ba2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:25.004926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 52/96] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:24 2022] GET /identity/v3/role_assignments?user.id=5b8bc8c97d8b42988e9534a42c6e4196&scope.project.id=dade56232c384d2d9bbeb826e849e4bc&role.id=adb2774e1d254454a97fab85c6000155 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:25.118857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab873d2-28eb-4e27-8a61-2d04467b9691 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:25.187591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1182c-2333-4d49-94e5-80193a1bde92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:25.188250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1182c-2333-4d49-94e5-80193a1bde92 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:25.188541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1182c-2333-4d49-94e5-80193a1bde92 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:25.188816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1182c-2333-4d49-94e5-80193a1bde92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:25.189595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1182c-2333-4d49-94e5-80193a1bde92 None admin] RBAC: Adding query filter params (role.id=8bc105194aae4f11b5a2b917bb621f1f, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008, user.id=5b8bc8c97d8b42988e9534a42c6e4196) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:25.189914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1182c-2333-4d49-94e5-80193a1bde92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:25.192455 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1182c-2333-4d49-94e5-80193a1bde92 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:25.198292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 45/97] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:24 2022] GET /identity/v3/role_assignments?user.id=5b8bc8c97d8b42988e9534a42c6e4196&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=8bc105194aae4f11b5a2b917bb621f1f => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:26.674123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f9f6-c21b-4b14-b271-e12d0ce94b0f None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:26.677038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f9f6-c21b-4b14-b271-e12d0ce94b0f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:26.677038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f9f6-c21b-4b14-b271-e12d0ce94b0f None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:26.677038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 53/98] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:26.682762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31a5cc-8f37-479f-b51e-0db3a54db3e4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:26.683598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31a5cc-8f37-479f-b51e-0db3a54db3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:26.684107 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31a5cc-8f37-479f-b51e-0db3a54db3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:26.701343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:26.712089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fd31a5cc-8f37-479f-b51e-0db3a54db3e4 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:26.714043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fd31a5cc-8f37-479f-b51e-0db3a54db3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:26.798310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 46/99] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:26.876748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8644-9180-49cd-9711-e8d60a8a62f3 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:26.877079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8644-9180-49cd-9711-e8d60a8a62f3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:26.877301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8644-9180-49cd-9711-e8d60a8a62f3 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:26.878756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 54/100] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:26.892071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850b337-28ee-42d0-a915-dfdc80b8dcad None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:26.892357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850b337-28ee-42d0-a915-dfdc80b8dcad None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:26.892630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850b337-28ee-42d0-a915-dfdc80b8dcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:26.918290 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f850b337-28ee-42d0-a915-dfdc80b8dcad None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:26.919528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f850b337-28ee-42d0-a915-dfdc80b8dcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:26.995862 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 47/101] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:27.075801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8644-9180-49cd-9711-e8d60a8a62f3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:27.111119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:27.222363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8644-9180-49cd-9711-e8d60a8a62f3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:27.257869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ce106-5975-4cee-8e26-2d76335318ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:27.258507 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce106-5975-4cee-8e26-2d76335318ff None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:27.258817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce106-5975-4cee-8e26-2d76335318ff None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:27.259093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce106-5975-4cee-8e26-2d76335318ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:27.273503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ce106-5975-4cee-8e26-2d76335318ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-624ce106-5975-4cee-8e26-2d76335318ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:27.278803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:27.279684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:27.280434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 55/102] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:27.285942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850b337-28ee-42d0-a915-dfdc80b8dcad None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:27.356633 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:27.402864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850b337-28ee-42d0-a915-dfdc80b8dcad None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:27.431370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571313-0045-43f9-b684-6c1b1db450f9 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:27.431665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571313-0045-43f9-b684-6c1b1db450f9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:27.431926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571313-0045-43f9-b684-6c1b1db450f9 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:27.433312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 56/103] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:27.443905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f86ff6-1ec7-4e86-a7de-8722a0b6a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:27.445936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0d9cc-448f-498f-ba9e-694ce2b9632f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:27.446218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0d9cc-448f-498f-ba9e-694ce2b9632f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:27.446494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0d9cc-448f-498f-ba9e-694ce2b9632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:27.451126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f86ff6-1ec7-4e86-a7de-8722a0b6a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:27.451422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f86ff6-1ec7-4e86-a7de-8722a0b6a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:27.451705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f86ff6-1ec7-4e86-a7de-8722a0b6a8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:27.452380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f86ff6-1ec7-4e86-a7de-8722a0b6a8d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:27.452688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f86ff6-1ec7-4e86-a7de-8722a0b6a8d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:27.456425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f86ff6-1ec7-4e86-a7de-8722a0b6a8d6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:27.473007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-32e0d9cc-448f-498f-ba9e-694ce2b9632f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:27.475477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 48/104] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:27.476668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-32e0d9cc-448f-498f-ba9e-694ce2b9632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:27.481853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f86ff6-1ec7-4e86-a7de-8722a0b6a8d6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:27.602771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 57/105] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:27.603642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0d9cc-448f-498f-ba9e-694ce2b9632f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:27.628691 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:27.656772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f86ff6-1ec7-4e86-a7de-8722a0b6a8d6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:27.707664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:27.724756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ca5e-4b21-4901-9720-21d80e6d8023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:27.725402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ca5e-4b21-4901-9720-21d80e6d8023 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:27.725737 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ca5e-4b21-4901-9720-21d80e6d8023 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:27.726761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ca5e-4b21-4901-9720-21d80e6d8023 None admin] PATH_INFO: `/v3/users/18472e7f3a9e420e9997a069c0d71656` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:27.755367 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ca5e-4b21-4901-9720-21d80e6d8023 None admin] RBAC: Authorizing `identity:get_user(user_id=18472e7f3a9e420e9997a069c0d71656)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:27.756859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ca5e-4b21-4901-9720-21d80e6d8023 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:27.759038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 49/106] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:27 2022] GET /identity/v3/users/18472e7f3a9e420e9997a069c0d71656 => generated 289 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:27.764338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ca5e-4b21-4901-9720-21d80e6d8023 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:27.809720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0d9cc-448f-498f-ba9e-694ce2b9632f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:27.915484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf43e-2db5-4fbc-abd9-49e5c28ad73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:27.916390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf43e-2db5-4fbc-abd9-49e5c28ad73c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:27.916819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf43e-2db5-4fbc-abd9-49e5c28ad73c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:27.917241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf43e-2db5-4fbc-abd9-49e5c28ad73c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:27.918812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bf43e-2db5-4fbc-abd9-49e5c28ad73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:27.920405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bf43e-2db5-4fbc-abd9-49e5c28ad73c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:27.922150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 58/107] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:27.935135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf43e-2db5-4fbc-abd9-49e5c28ad73c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:27.955603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ca5e-4b21-4901-9720-21d80e6d8023 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:28.014373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bc41d-38d0-4c6b-ada2-e1666d8d7045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:28.015198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bc41d-38d0-4c6b-ada2-e1666d8d7045 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.015591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bc41d-38d0-4c6b-ada2-e1666d8d7045 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.025472 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bc41d-38d0-4c6b-ada2-e1666d8d7045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.077403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:28.111148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:28.111703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf43e-2db5-4fbc-abd9-49e5c28ad73c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:28.129512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bc41d-38d0-4c6b-ada2-e1666d8d7045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:28.131044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bc41d-38d0-4c6b-ada2-e1666d8d7045 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:28.178100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa883899-935b-429c-a4b8-9297a4108179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:28.179459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa883899-935b-429c-a4b8-9297a4108179 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.179946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa883899-935b-429c-a4b8-9297a4108179 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.180433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa883899-935b-429c-a4b8-9297a4108179 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.181286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa883899-935b-429c-a4b8-9297a4108179 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:28.182983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa883899-935b-429c-a4b8-9297a4108179 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:28.234966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 50/108] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:20:28.240691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bc41d-38d0-4c6b-ada2-e1666d8d7045 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:28.254189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 59/109] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:20:27 2022] POST /identity/v3/projects => generated 302 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:28.254934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa883899-935b-429c-a4b8-9297a4108179 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:28.347074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:28.358665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bc41d-38d0-4c6b-ada2-e1666d8d7045 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:28.402587 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf22f3-2cbe-430d-b505-d922fa1e046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:28.403287 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf22f3-2cbe-430d-b505-d922fa1e046e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.403572 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf22f3-2cbe-430d-b505-d922fa1e046e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.403846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf22f3-2cbe-430d-b505-d922fa1e046e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.418068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf22f3-2cbe-430d-b505-d922fa1e046e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ffaf22f3-2cbe-430d-b505-d922fa1e046e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:28.423417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:28.424341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:28.425131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 51/110] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:28.426549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c180ec-bbdc-4802-b8b3-959bfa2103a9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.426643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c180ec-bbdc-4802-b8b3-959bfa2103a9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.426932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c180ec-bbdc-4802-b8b3-959bfa2103a9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.428235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 52/111] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:28.432020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c180ec-bbdc-4802-b8b3-959bfa2103a9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:28.442964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa883899-935b-429c-a4b8-9297a4108179 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:28.501997 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18233e-ce72-408e-95e6-dc8d89b85705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:28.502699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18233e-ce72-408e-95e6-dc8d89b85705 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.503009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18233e-ce72-408e-95e6-dc8d89b85705 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.503290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18233e-ce72-408e-95e6-dc8d89b85705 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.504668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18233e-ce72-408e-95e6-dc8d89b85705 None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:28.506339 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18233e-ce72-408e-95e6-dc8d89b85705 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:28.508461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 60/112] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:28 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:28.509556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda0957-2f5a-4f52-a969-f9e07d303bbb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.509843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda0957-2f5a-4f52-a969-f9e07d303bbb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.510119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda0957-2f5a-4f52-a969-f9e07d303bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.517333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:28.532558 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8fda0957-2f5a-4f52-a969-f9e07d303bbb None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:28.534830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8fda0957-2f5a-4f52-a969-f9e07d303bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:28.559576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c180ec-bbdc-4802-b8b3-959bfa2103a9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:28.601463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55c087-f8da-42bf-9ab3-d88320c4621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:28.602237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c087-f8da-42bf-9ab3-d88320c4621b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.602519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c087-f8da-42bf-9ab3-d88320c4621b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.603111 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c087-f8da-42bf-9ab3-d88320c4621b None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.604313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55c087-f8da-42bf-9ab3-d88320c4621b None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:28.604313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55c087-f8da-42bf-9ab3-d88320c4621b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:28.605973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55c087-f8da-42bf-9ab3-d88320c4621b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:28.620093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 53/113] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:28.620093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1ec1f-8dca-4414-bb2f-253a15988149 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.620093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1ec1f-8dca-4414-bb2f-253a15988149 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.620093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1ec1f-8dca-4414-bb2f-253a15988149 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.620093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 54/114] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:28.620867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1ec1f-8dca-4414-bb2f-253a15988149 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:28.625061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 61/115] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:28.629076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda0957-2f5a-4f52-a969-f9e07d303bbb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:28.643208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:28.765524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda0957-2f5a-4f52-a969-f9e07d303bbb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:28.781521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1ec1f-8dca-4414-bb2f-253a15988149 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:28.833059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:28.839541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fd85e-947b-4f3d-abf8-050d1c466ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:28.840358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fd85e-947b-4f3d-abf8-050d1c466ffe None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.840610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fd85e-947b-4f3d-abf8-050d1c466ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.840915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fd85e-947b-4f3d-abf8-050d1c466ffe None admin] PATH_INFO: `/v3/users/5b8bc8c97d8b42988e9534a42c6e4196` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.842334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fd85e-947b-4f3d-abf8-050d1c466ffe None admin] RBAC: Authorizing `identity:get_user(user_id=5b8bc8c97d8b42988e9534a42c6e4196)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:28.844097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fd85e-947b-4f3d-abf8-050d1c466ffe None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:28.846010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 62/116] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:28 2022] GET /identity/v3/users/5b8bc8c97d8b42988e9534a42c6e4196 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:28.851102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6cef-fcc7-47cc-97c6-982b1db9db1a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.851102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6cef-fcc7-47cc-97c6-982b1db9db1a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.851102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6cef-fcc7-47cc-97c6-982b1db9db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.872588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacce4fc-f7cf-4a05-bf1e-2396f172057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:28.873608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacce4fc-f7cf-4a05-bf1e-2396f172057b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:28.874090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacce4fc-f7cf-4a05-bf1e-2396f172057b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:28.874578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacce4fc-f7cf-4a05-bf1e-2396f172057b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:28.875606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacce4fc-f7cf-4a05-bf1e-2396f172057b None admin] RBAC: Adding query filter params (role.id=af54b7a166d9431c8f6a2fde986f4cda, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008, user.id=18472e7f3a9e420e9997a069c0d71656) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:28.876163 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacce4fc-f7cf-4a05-bf1e-2396f172057b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:28.877884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacce4fc-f7cf-4a05-bf1e-2396f172057b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:28.889767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-89dc6cef-fcc7-47cc-97c6-982b1db9db1a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:28.891556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-89dc6cef-fcc7-47cc-97c6-982b1db9db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:28.894376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 55/117] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:28 2022] GET /identity/v3/role_assignments?user.id=18472e7f3a9e420e9997a069c0d71656&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=af54b7a166d9431c8f6a2fde986f4cda => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:28.897576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacce4fc-f7cf-4a05-bf1e-2396f172057b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:29.042091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:29.046228 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 63/118] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:29.047664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a220f-4231-4b1d-a3f0-a52d4a0e77fc None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:29.047964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a220f-4231-4b1d-a3f0-a52d4a0e77fc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:29.048373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a220f-4231-4b1d-a3f0-a52d4a0e77fc None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:29.050203 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 64/119] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:29.052094 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a220f-4231-4b1d-a3f0-a52d4a0e77fc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:29.113262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacce4fc-f7cf-4a05-bf1e-2396f172057b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:29.161617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a97e7e-7ce3-4e14-9afe-7cebe919ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:29.162516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97e7e-7ce3-4e14-9afe-7cebe919ae77 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:29.162835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97e7e-7ce3-4e14-9afe-7cebe919ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:29.163115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97e7e-7ce3-4e14-9afe-7cebe919ae77 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:29.165482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a97e7e-7ce3-4e14-9afe-7cebe919ae77 None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:29.167494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a97e7e-7ce3-4e14-9afe-7cebe919ae77 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:29.172279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 56/120] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:28 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:29.173482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1b0e7-d296-4dbc-88ea-0c8d87f6fb48 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:29.173769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1b0e7-d296-4dbc-88ea-0c8d87f6fb48 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:29.174045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1b0e7-d296-4dbc-88ea-0c8d87f6fb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:29.180671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a220f-4231-4b1d-a3f0-a52d4a0e77fc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:29.214717 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-28f1b0e7-d296-4dbc-88ea-0c8d87f6fb48 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:29.215941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-28f1b0e7-d296-4dbc-88ea-0c8d87f6fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:29.232644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:29.241793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0636-2a2d-426c-b2bd-0b79a5b9fcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:29.244392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0636-2a2d-426c-b2bd-0b79a5b9fcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:29.244901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0636-2a2d-426c-b2bd-0b79a5b9fcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:29.245408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0636-2a2d-426c-b2bd-0b79a5b9fcc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:29.269600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d0636-2a2d-426c-b2bd-0b79a5b9fcc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d40d0636-2a2d-426c-b2bd-0b79a5b9fcc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:29.276605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:29.277463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:29.278249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:29.286812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 65/121] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:20:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:29.287655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0636-2a2d-426c-b2bd-0b79a5b9fcc3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:29.353362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 57/122] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:29.354276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1b0e7-d296-4dbc-88ea-0c8d87f6fb48 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:29.462500 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0636-2a2d-426c-b2bd-0b79a5b9fcc3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:29.482704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:29.534189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e082095-abc8-421c-8f3f-4a44ab05ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:29.534877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082095-abc8-421c-8f3f-4a44ab05ff9b None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:29.535160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082095-abc8-421c-8f3f-4a44ab05ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:29.535435 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082095-abc8-421c-8f3f-4a44ab05ff9b None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/users/5b8bc8c97d8b42988e9534a42c6e4196/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:29.539463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e082095-abc8-421c-8f3f-4a44ab05ff9b None admin] RBAC: Authorizing `identity:create_grant(project_id=6f765e7077fd48a9a2c1f5169c76b008, user_id=5b8bc8c97d8b42988e9534a42c6e4196, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:29.540910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e082095-abc8-421c-8f3f-4a44ab05ff9b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:29.543971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1b0e7-d296-4dbc-88ea-0c8d87f6fb48 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:29.566028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 66/123] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:20:29 2022] PUT /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/users/5b8bc8c97d8b42988e9534a42c6e4196/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:20:29.566964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e082095-abc8-421c-8f3f-4a44ab05ff9b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:29.623498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302588d-a490-434a-9437-ab169e469eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:29.624037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302588d-a490-434a-9437-ab169e469eda None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:29.624317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302588d-a490-434a-9437-ab169e469eda None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:29.624590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302588d-a490-434a-9437-ab169e469eda None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:29.625264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302588d-a490-434a-9437-ab169e469eda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:29.625570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302588d-a490-434a-9437-ab169e469eda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:29.626985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302588d-a490-434a-9437-ab169e469eda None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:29.644150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 58/124] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:29.657368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302588d-a490-434a-9437-ab169e469eda None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:29.662246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:29.726321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e082095-abc8-421c-8f3f-4a44ab05ff9b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:29.765017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b14d1-865f-4f3a-8f8e-1b4ebaeb0c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:29.765888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b14d1-865f-4f3a-8f8e-1b4ebaeb0c20 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:29.766172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b14d1-865f-4f3a-8f8e-1b4ebaeb0c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:29.766543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b14d1-865f-4f3a-8f8e-1b4ebaeb0c20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:29.780603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b14d1-865f-4f3a-8f8e-1b4ebaeb0c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-fc3b14d1-865f-4f3a-8f8e-1b4ebaeb0c20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:29.796259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:29.797179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:29.797946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 67/125] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:29.798583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b14d1-865f-4f3a-8f8e-1b4ebaeb0c20 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:29.844380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302588d-a490-434a-9437-ab169e469eda None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:29.887310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:29.895328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30728155-8c59-42b4-8cb0-343bebf98be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:29.895971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30728155-8c59-42b4-8cb0-343bebf98be8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:29.896254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30728155-8c59-42b4-8cb0-343bebf98be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:29.896532 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30728155-8c59-42b4-8cb0-343bebf98be8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:29.910341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30728155-8c59-42b4-8cb0-343bebf98be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-30728155-8c59-42b4-8cb0-343bebf98be8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:29.917822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:29.918722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:29.919514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 59/126] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:20:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:29.920173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30728155-8c59-42b4-8cb0-343bebf98be8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:29.931994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b14d1-865f-4f3a-8f8e-1b4ebaeb0c20 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:29.944007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:29.990276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d3130-226a-41cb-b01b-e095ef3ba9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:29.991217 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d3130-226a-41cb-b01b-e095ef3ba9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:29.992167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d3130-226a-41cb-b01b-e095ef3ba9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:29.992583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d3130-226a-41cb-b01b-e095ef3ba9d8 None admin] PATH_INFO: `/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:29.995292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d3130-226a-41cb-b01b-e095ef3ba9d8 None admin] RBAC: Authorizing `identity:get_user(user_id=e9cbf2d8bf704c83aab7f97b0095bb79)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:29.996917 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d3130-226a-41cb-b01b-e095ef3ba9d8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:29.999382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 68/127] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:29 2022] GET /identity/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:30.000463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d3130-226a-41cb-b01b-e095ef3ba9d8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:30.098611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30728155-8c59-42b4-8cb0-343bebf98be8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:30.159742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94240b62-a92a-4852-b8b8-0c4a51c33abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:30.160576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94240b62-a92a-4852-b8b8-0c4a51c33abf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:30.162002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94240b62-a92a-4852-b8b8-0c4a51c33abf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:30.162416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94240b62-a92a-4852-b8b8-0c4a51c33abf None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:30.163259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94240b62-a92a-4852-b8b8-0c4a51c33abf None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:30.164391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94240b62-a92a-4852-b8b8-0c4a51c33abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:30.166878 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94240b62-a92a-4852-b8b8-0c4a51c33abf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:30.181052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 60/128] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:30.182608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94240b62-a92a-4852-b8b8-0c4a51c33abf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:30.185084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d3130-226a-41cb-b01b-e095ef3ba9d8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:30.244972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7ce32-9add-49a5-bedd-8d7779a3e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:30.245895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ce32-9add-49a5-bedd-8d7779a3e2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:30.247139 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ce32-9add-49a5-bedd-8d7779a3e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:30.247567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ce32-9add-49a5-bedd-8d7779a3e2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:30.252285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7ce32-9add-49a5-bedd-8d7779a3e2e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:30.252751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7ce32-9add-49a5-bedd-8d7779a3e2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:30.254288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7ce32-9add-49a5-bedd-8d7779a3e2e9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:30.267108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 69/129] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:20:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:30.271594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7ce32-9add-49a5-bedd-8d7779a3e2e9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:30.291030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:30.345659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:30.379826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94240b62-a92a-4852-b8b8-0c4a51c33abf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:30.450437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8267e2-5097-4c64-b369-cb6c285ec1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:30.451114 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8267e2-5097-4c64-b369-cb6c285ec1fd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:30.451400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8267e2-5097-4c64-b369-cb6c285ec1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:30.451677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8267e2-5097-4c64-b369-cb6c285ec1fd None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:30.454900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7ce32-9add-49a5-bedd-8d7779a3e2e9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:30.457140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8267e2-5097-4c64-b369-cb6c285ec1fd None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:30.458637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8267e2-5097-4c64-b369-cb6c285ec1fd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:30.460402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 61/130] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:30 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:30.461325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8267e2-5097-4c64-b369-cb6c285ec1fd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:30.499200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371f697-502e-4fcb-955a-397864deeeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:30.500142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371f697-502e-4fcb-955a-397864deeeff None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:30.500427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371f697-502e-4fcb-955a-397864deeeff None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:30.500703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371f697-502e-4fcb-955a-397864deeeff None admin] PATH_INFO: `/v3/users/5b8bc8c97d8b42988e9534a42c6e4196` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:30.501976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371f697-502e-4fcb-955a-397864deeeff None admin] RBAC: Authorizing `identity:get_user(user_id=5b8bc8c97d8b42988e9534a42c6e4196)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:30.503573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371f697-502e-4fcb-955a-397864deeeff None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:30.505723 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 70/131] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:30 2022] GET /identity/v3/users/5b8bc8c97d8b42988e9534a42c6e4196 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:30.506487 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371f697-502e-4fcb-955a-397864deeeff None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:30.616512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371f697-502e-4fcb-955a-397864deeeff None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:30.633270 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:30.655100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e977c1-8a61-48ad-ad59-c8e7da0ab44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:30.655770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e977c1-8a61-48ad-ad59-c8e7da0ab44c None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:30.656057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e977c1-8a61-48ad-ad59-c8e7da0ab44c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:30.656334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e977c1-8a61-48ad-ad59-c8e7da0ab44c None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/users/e9cbf2d8bf704c83aab7f97b0095bb79/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:30.658346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e977c1-8a61-48ad-ad59-c8e7da0ab44c None admin] RBAC: Authorizing `identity:create_grant(project_id=6f765e7077fd48a9a2c1f5169c76b008, user_id=e9cbf2d8bf704c83aab7f97b0095bb79, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:30.659870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e977c1-8a61-48ad-ad59-c8e7da0ab44c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:30.678502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 71/132] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:20:30 2022] PUT /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/users/e9cbf2d8bf704c83aab7f97b0095bb79/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:20:30.679572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e977c1-8a61-48ad-ad59-c8e7da0ab44c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:30.720689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8267e2-5097-4c64-b369-cb6c285ec1fd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:30.747542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:30.774112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47ae0b-3add-43fe-82e7-979c008ecaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:30.774797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ae0b-3add-43fe-82e7-979c008ecaed None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:30.775138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ae0b-3add-43fe-82e7-979c008ecaed None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:30.775418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ae0b-3add-43fe-82e7-979c008ecaed None admin] PATH_INFO: `/v3/users/5b8bc8c97d8b42988e9534a42c6e4196` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:30.778170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47ae0b-3add-43fe-82e7-979c008ecaed None admin] RBAC: Authorizing `identity:get_user(user_id=5b8bc8c97d8b42988e9534a42c6e4196)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:30.779688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47ae0b-3add-43fe-82e7-979c008ecaed None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:30.781537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 62/133] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:30 2022] GET /identity/v3/users/5b8bc8c97d8b42988e9534a42c6e4196 => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:30.791077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47ae0b-3add-43fe-82e7-979c008ecaed None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:30.856538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e977c1-8a61-48ad-ad59-c8e7da0ab44c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:30.929013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a41704-8818-4013-816e-bc61ffa11128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:30.929961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a41704-8818-4013-816e-bc61ffa11128 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:30.930259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a41704-8818-4013-816e-bc61ffa11128 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:30.930541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a41704-8818-4013-816e-bc61ffa11128 None admin] PATH_INFO: `/v3/projects/dade56232c384d2d9bbeb826e849e4bc` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:30.936731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a41704-8818-4013-816e-bc61ffa11128 None admin] RBAC: Authorizing `identity:get_project(project_id=dade56232c384d2d9bbeb826e849e4bc)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:30.938291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a41704-8818-4013-816e-bc61ffa11128 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:30.947828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 72/134] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:30 2022] GET /identity/v3/projects/dade56232c384d2d9bbeb826e849e4bc => generated 312 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:30.953919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a41704-8818-4013-816e-bc61ffa11128 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:30.990750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47ae0b-3add-43fe-82e7-979c008ecaed None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:31.028136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:31.036167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d64ba-313d-48f6-9cb7-904d9a6f6934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:31.036864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d64ba-313d-48f6-9cb7-904d9a6f6934 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:31.037522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d64ba-313d-48f6-9cb7-904d9a6f6934 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:31.037522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d64ba-313d-48f6-9cb7-904d9a6f6934 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:31.038921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d64ba-313d-48f6-9cb7-904d9a6f6934 None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:31.040490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d64ba-313d-48f6-9cb7-904d9a6f6934 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:31.042206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 63/135] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:30 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:31.043372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26abfc4-272f-47e3-92ce-0435ea15e8c2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:31.043724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26abfc4-272f-47e3-92ce-0435ea15e8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:31.044007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26abfc4-272f-47e3-92ce-0435ea15e8c2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:31.045206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 64/136] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:31.048948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26abfc4-272f-47e3-92ce-0435ea15e8c2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:31.107551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a41704-8818-4013-816e-bc61ffa11128 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:31.116576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:31.152115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6b68-f395-47f9-86cf-156173dae714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:31.153664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6b68-f395-47f9-86cf-156173dae714 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:31.154144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6b68-f395-47f9-86cf-156173dae714 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:31.154919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6b68-f395-47f9-86cf-156173dae714 None admin] PATH_INFO: `/v3/projects/dade56232c384d2d9bbeb826e849e4bc/users/5b8bc8c97d8b42988e9534a42c6e4196/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:31.157308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d6b68-f395-47f9-86cf-156173dae714 None admin] RBAC: Authorizing `identity:create_grant(project_id=dade56232c384d2d9bbeb826e849e4bc, user_id=5b8bc8c97d8b42988e9534a42c6e4196, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:31.159234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d6b68-f395-47f9-86cf-156173dae714 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:31.170890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26abfc4-272f-47e3-92ce-0435ea15e8c2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:31.201738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 73/137] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:20:30 2022] PUT /identity/v3/projects/dade56232c384d2d9bbeb826e849e4bc/users/5b8bc8c97d8b42988e9534a42c6e4196/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:20:31.203057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31974fcf-52f2-4b50-bf31-629cb09fdd84 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:31.203414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31974fcf-52f2-4b50-bf31-629cb09fdd84 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:31.203785 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31974fcf-52f2-4b50-bf31-629cb09fdd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:31.223547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759944c5-b065-4025-a698-89c606b52553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:31.224515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759944c5-b065-4025-a698-89c606b52553 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:31.224966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759944c5-b065-4025-a698-89c606b52553 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:31.225386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759944c5-b065-4025-a698-89c606b52553 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/users/5b8bc8c97d8b42988e9534a42c6e4196/roles/8bc105194aae4f11b5a2b917bb621f1f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:31.231948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759944c5-b065-4025-a698-89c606b52553 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f765e7077fd48a9a2c1f5169c76b008, user_id=5b8bc8c97d8b42988e9534a42c6e4196, role_id=8bc105194aae4f11b5a2b917bb621f1f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:31.234243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759944c5-b065-4025-a698-89c606b52553 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:31.238411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-31974fcf-52f2-4b50-bf31-629cb09fdd84 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:31.239752 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-31974fcf-52f2-4b50-bf31-629cb09fdd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:31.261732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 65/138] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:20:31 2022] PUT /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/users/5b8bc8c97d8b42988e9534a42c6e4196/roles/8bc105194aae4f11b5a2b917bb621f1f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:20:31.374037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 74/139] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:31.836460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc56178-e35e-4134-b567-9b62560a842c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:31.837151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc56178-e35e-4134-b567-9b62560a842c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:31.837659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc56178-e35e-4134-b567-9b62560a842c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:31.839232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 66/140] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:31.844663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307eb5-7918-4863-bcff-e0adab634754 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:31.845196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307eb5-7918-4863-bcff-e0adab634754 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:31.845693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307eb5-7918-4863-bcff-e0adab634754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:31.869136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc56178-e35e-4134-b567-9b62560a842c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:31.871137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-13307eb5-7918-4863-bcff-e0adab634754 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:31.872669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-13307eb5-7918-4863-bcff-e0adab634754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:31.901415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:31.972048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 75/141] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:32.056376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc56178-e35e-4134-b567-9b62560a842c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:32.080608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:32.112884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbb370-74e3-4f05-8250-b2034cfd25b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:32.113523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbb370-74e3-4f05-8250-b2034cfd25b4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:32.113806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbb370-74e3-4f05-8250-b2034cfd25b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:32.114086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbb370-74e3-4f05-8250-b2034cfd25b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:32.115298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbb370-74e3-4f05-8250-b2034cfd25b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:32.116881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbb370-74e3-4f05-8250-b2034cfd25b4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:32.118735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 67/142] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:32.124246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13307eb5-7918-4863-bcff-e0adab634754 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:32.251041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13307eb5-7918-4863-bcff-e0adab634754 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:32.294133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075644eb-4843-41c2-9574-7d0ba38056ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:32.295178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075644eb-4843-41c2-9574-7d0ba38056ea None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:32.295673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075644eb-4843-41c2-9574-7d0ba38056ea None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:32.296156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075644eb-4843-41c2-9574-7d0ba38056ea None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:32.297096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075644eb-4843-41c2-9574-7d0ba38056ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:32.298852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075644eb-4843-41c2-9574-7d0ba38056ea None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:32.327197 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 76/143] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:20:32 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:32.407774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec029d-bd62-4ae3-923e-3696ca40f727 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:32.408086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec029d-bd62-4ae3-923e-3696ca40f727 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:32.408253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec029d-bd62-4ae3-923e-3696ca40f727 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:32.409634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 68/144] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:32.415879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc647d-72fe-4936-acc0-a92f4020a20c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:32.416541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc647d-72fe-4936-acc0-a92f4020a20c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:32.417037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc647d-72fe-4936-acc0-a92f4020a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:32.443542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-cccc647d-72fe-4936-acc0-a92f4020a20c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:32.445348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cccc647d-72fe-4936-acc0-a92f4020a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:32.459051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:32.543852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 77/145] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:32.560329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec029d-bd62-4ae3-923e-3696ca40f727 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:32.689055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec029d-bd62-4ae3-923e-3696ca40f727 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:32.735937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8984040-2506-4bb8-ae38-f687db6298f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:32.736940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8984040-2506-4bb8-ae38-f687db6298f7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:32.737425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8984040-2506-4bb8-ae38-f687db6298f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:32.737911 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8984040-2506-4bb8-ae38-f687db6298f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:32.753135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8984040-2506-4bb8-ae38-f687db6298f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b8984040-2506-4bb8-ae38-f687db6298f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:32.758928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:32.759820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:32.760625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:32.762881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 69/146] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:32.769755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc647d-72fe-4936-acc0-a92f4020a20c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:32.906455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc647d-72fe-4936-acc0-a92f4020a20c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:32.954315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b43c1-6dec-4634-8539-175f3182e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:32.954889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b43c1-6dec-4634-8539-175f3182e062 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:32.955303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b43c1-6dec-4634-8539-175f3182e062 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:32.955502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b43c1-6dec-4634-8539-175f3182e062 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:32.956155 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b43c1-6dec-4634-8539-175f3182e062 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:32.956462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b43c1-6dec-4634-8539-175f3182e062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:32.957837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b43c1-6dec-4634-8539-175f3182e062 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:32.969823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 78/147] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:32.975484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8984040-2506-4bb8-ae38-f687db6298f7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:33.044216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:33.101569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b43c1-6dec-4634-8539-175f3182e062 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:33.106310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:33.125621 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8984040-2506-4bb8-ae38-f687db6298f7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:33.185030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a400dc-abd3-4030-a6bd-6526ba37e4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:33.185986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a400dc-abd3-4030-a6bd-6526ba37e4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:33.186456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a400dc-abd3-4030-a6bd-6526ba37e4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:33.186929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a400dc-abd3-4030-a6bd-6526ba37e4f1 None admin] PATH_INFO: `/v3/users/18472e7f3a9e420e9997a069c0d71656` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:33.188247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a400dc-abd3-4030-a6bd-6526ba37e4f1 None admin] RBAC: Authorizing `identity:get_user(user_id=18472e7f3a9e420e9997a069c0d71656)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:33.189929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a400dc-abd3-4030-a6bd-6526ba37e4f1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:33.191688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 70/148] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:32 2022] GET /identity/v3/users/18472e7f3a9e420e9997a069c0d71656 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:33.198110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a400dc-abd3-4030-a6bd-6526ba37e4f1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:33.248394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b43c1-6dec-4634-8539-175f3182e062 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:33.290706 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab79a1-34be-46de-b86d-dbaacb7713da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:33.291353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab79a1-34be-46de-b86d-dbaacb7713da None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:33.291629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab79a1-34be-46de-b86d-dbaacb7713da None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:33.291901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab79a1-34be-46de-b86d-dbaacb7713da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:33.311545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab79a1-34be-46de-b86d-dbaacb7713da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-efab79a1-34be-46de-b86d-dbaacb7713da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:33.316863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:33.317717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:33.318484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 79/149] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:33.327933 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab79a1-34be-46de-b86d-dbaacb7713da None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:33.377417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a400dc-abd3-4030-a6bd-6526ba37e4f1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:33.399832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:33.409929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:33.436149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524804de-4600-4dd4-a099-dcd6316d91bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:33.436799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524804de-4600-4dd4-a099-dcd6316d91bd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:33.437080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524804de-4600-4dd4-a099-dcd6316d91bd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:33.437350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524804de-4600-4dd4-a099-dcd6316d91bd None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:33.439148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524804de-4600-4dd4-a099-dcd6316d91bd None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:33.440622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524804de-4600-4dd4-a099-dcd6316d91bd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:33.442278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 71/150] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:33 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:33.450636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524804de-4600-4dd4-a099-dcd6316d91bd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:33.491016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab79a1-34be-46de-b86d-dbaacb7713da None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:33.552963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe65e6-c147-4370-80ba-c4b0ade09145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:33.553502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe65e6-c147-4370-80ba-c4b0ade09145 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:33.554906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe65e6-c147-4370-80ba-c4b0ade09145 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:33.555341 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe65e6-c147-4370-80ba-c4b0ade09145 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:33.556353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe65e6-c147-4370-80ba-c4b0ade09145 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:33.556667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe65e6-c147-4370-80ba-c4b0ade09145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:33.558059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe65e6-c147-4370-80ba-c4b0ade09145 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:33.573045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 80/151] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:33.580068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe65e6-c147-4370-80ba-c4b0ade09145 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:33.673123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524804de-4600-4dd4-a099-dcd6316d91bd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:33.745668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe65e6-c147-4370-80ba-c4b0ade09145 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:33.754274 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f19a2a-df2b-496a-a6a4-9ae20f1570b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:33.754987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f19a2a-df2b-496a-a6a4-9ae20f1570b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:33.755270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f19a2a-df2b-496a-a6a4-9ae20f1570b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:33.755547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f19a2a-df2b-496a-a6a4-9ae20f1570b6 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/users/18472e7f3a9e420e9997a069c0d71656/roles/af54b7a166d9431c8f6a2fde986f4cda` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:33.757899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f19a2a-df2b-496a-a6a4-9ae20f1570b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f765e7077fd48a9a2c1f5169c76b008, user_id=18472e7f3a9e420e9997a069c0d71656, role_id=af54b7a166d9431c8f6a2fde986f4cda)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:33.759369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f19a2a-df2b-496a-a6a4-9ae20f1570b6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:33.784909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:33.789240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 72/152] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:20:33 2022] PUT /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/users/18472e7f3a9e420e9997a069c0d71656/roles/af54b7a166d9431c8f6a2fde986f4cda => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:20:33.795181 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32e7cb-ae13-45de-8ade-764646294bcc None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:33.795468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32e7cb-ae13-45de-8ade-764646294bcc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:33.795749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32e7cb-ae13-45de-8ade-764646294bcc None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:33.797157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 73/153] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:33.803377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a48a3-26c4-41ea-b073-d02d7c79ba08 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:33.803545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0909e9-2446-4584-bafd-d87f11ecf6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:33.803645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a48a3-26c4-41ea-b073-d02d7c79ba08 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:33.804030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a48a3-26c4-41ea-b073-d02d7c79ba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:33.804212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0909e9-2446-4584-bafd-d87f11ecf6de None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:33.804541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0909e9-2446-4584-bafd-d87f11ecf6de None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:33.804817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0909e9-2446-4584-bafd-d87f11ecf6de None admin] PATH_INFO: `/v3/users/5b8bc8c97d8b42988e9534a42c6e4196` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:33.806767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0909e9-2446-4584-bafd-d87f11ecf6de None admin] RBAC: Authorizing `identity:get_user(user_id=5b8bc8c97d8b42988e9534a42c6e4196)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:33.808343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0909e9-2446-4584-bafd-d87f11ecf6de None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:33.810388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 81/154] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:33 2022] GET /identity/v3/users/5b8bc8c97d8b42988e9534a42c6e4196 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:33.825741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0909e9-2446-4584-bafd-d87f11ecf6de None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:33.830389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3b0a48a3-26c4-41ea-b073-d02d7c79ba08 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:33.831634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3b0a48a3-26c4-41ea-b073-d02d7c79ba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:33.895813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:33.959535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 74/155] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:34.002951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0909e9-2446-4584-bafd-d87f11ecf6de None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:34.051362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29900748-2fc6-43cf-abf3-6a074846b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:34.051987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29900748-2fc6-43cf-abf3-6a074846b977 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:34.052265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29900748-2fc6-43cf-abf3-6a074846b977 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:34.052535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29900748-2fc6-43cf-abf3-6a074846b977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:34.131070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:34.144965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29900748-2fc6-43cf-abf3-6a074846b977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:34.147188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29900748-2fc6-43cf-abf3-6a074846b977 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:34.288859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 82/156] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:34.294983 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a48a3-26c4-41ea-b073-d02d7c79ba08 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:34.426624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a48a3-26c4-41ea-b073-d02d7c79ba08 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:34.488100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a916de8-f3e0-4e25-bdfe-858b24a134fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:34.488740 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a916de8-f3e0-4e25-bdfe-858b24a134fd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:34.489020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a916de8-f3e0-4e25-bdfe-858b24a134fd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:34.489293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a916de8-f3e0-4e25-bdfe-858b24a134fd None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:34.495375 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a916de8-f3e0-4e25-bdfe-858b24a134fd None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:34.496850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a916de8-f3e0-4e25-bdfe-858b24a134fd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:34.498551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 75/157] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:34 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:34.498888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29900748-2fc6-43cf-abf3-6a074846b977 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:34.504544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a916de8-f3e0-4e25-bdfe-858b24a134fd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:34.584729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:34.697171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a916de8-f3e0-4e25-bdfe-858b24a134fd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:34.711129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:34.720129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29900748-2fc6-43cf-abf3-6a074846b977 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:34.772487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d06093-eb27-4529-b8d8-d44c465bdff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:34.773781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d06093-eb27-4529-b8d8-d44c465bdff1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:34.774059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d06093-eb27-4529-b8d8-d44c465bdff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:34.774325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d06093-eb27-4529-b8d8-d44c465bdff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:34.775083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d06093-eb27-4529-b8d8-d44c465bdff1 None admin] RBAC: Adding query filter params (role.id=adb2774e1d254454a97fab85c6000155, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008, user.id=5b8bc8c97d8b42988e9534a42c6e4196) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:34.775397 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d06093-eb27-4529-b8d8-d44c465bdff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:34.776852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d06093-eb27-4529-b8d8-d44c465bdff1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:34.788088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 76/158] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:34 2022] GET /identity/v3/role_assignments?user.id=5b8bc8c97d8b42988e9534a42c6e4196&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=adb2774e1d254454a97fab85c6000155 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:34.798599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01648151-e893-44ed-92e7-33227df68bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:34.799279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01648151-e893-44ed-92e7-33227df68bcc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:34.799556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01648151-e893-44ed-92e7-33227df68bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:34.799826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01648151-e893-44ed-92e7-33227df68bcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:34.815818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01648151-e893-44ed-92e7-33227df68bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-01648151-e893-44ed-92e7-33227df68bcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:34.822118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:34.823161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:34.823960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:34.831834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 83/159] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:20:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:34.843865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d06093-eb27-4529-b8d8-d44c465bdff1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:34.996371 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d06093-eb27-4529-b8d8-d44c465bdff1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:34.998903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:35.040913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf54b9-e6da-4369-bb1a-228a9da5b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:35.041540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf54b9-e6da-4369-bb1a-228a9da5b812 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:35.041817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf54b9-e6da-4369-bb1a-228a9da5b812 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:35.042089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf54b9-e6da-4369-bb1a-228a9da5b812 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:35.042790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf54b9-e6da-4369-bb1a-228a9da5b812 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:35.043097 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf54b9-e6da-4369-bb1a-228a9da5b812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:35.044496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf54b9-e6da-4369-bb1a-228a9da5b812 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:35.059325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 77/160] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:35.065099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01648151-e893-44ed-92e7-33227df68bcc None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:35.222458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01648151-e893-44ed-92e7-33227df68bcc None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:35.243718 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43fa3-6745-42ad-a86a-811e3d630303 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:35.244033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43fa3-6745-42ad-a86a-811e3d630303 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:35.244270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43fa3-6745-42ad-a86a-811e3d630303 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:35.245611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 78/161] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:35.250913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677b4d0-eedf-4df7-938e-cc6d11f8bd4a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:35.251132 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677b4d0-eedf-4df7-938e-cc6d11f8bd4a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:35.251411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677b4d0-eedf-4df7-938e-cc6d11f8bd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:35.300754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3677b4d0-eedf-4df7-938e-cc6d11f8bd4a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:35.301970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3677b4d0-eedf-4df7-938e-cc6d11f8bd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:35.308524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179ff7d-329d-4cc4-be1f-66261008bb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:35.309543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179ff7d-329d-4cc4-be1f-66261008bb93 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:35.310053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179ff7d-329d-4cc4-be1f-66261008bb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:35.310569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179ff7d-329d-4cc4-be1f-66261008bb93 None admin] PATH_INFO: `/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:35.317471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179ff7d-329d-4cc4-be1f-66261008bb93 None admin] RBAC: Authorizing `identity:get_user(user_id=e9cbf2d8bf704c83aab7f97b0095bb79)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:35.319236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179ff7d-329d-4cc4-be1f-66261008bb93 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:35.321960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 84/162] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:35 2022] GET /identity/v3/users/e9cbf2d8bf704c83aab7f97b0095bb79 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:35.323642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e8e80-9b83-4a3d-a4b5-05d374e09bda None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:35.324218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e8e80-9b83-4a3d-a4b5-05d374e09bda None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:35.324718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e8e80-9b83-4a3d-a4b5-05d374e09bda None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:35.326163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 85/163] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:35.332134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66754b79-7643-427b-8c5a-86105b807ba9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:35.332744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66754b79-7643-427b-8c5a-86105b807ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:35.333285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66754b79-7643-427b-8c5a-86105b807ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:35.363410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-66754b79-7643-427b-8c5a-86105b807ba9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:35.364959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-66754b79-7643-427b-8c5a-86105b807ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:35.400596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:35.441104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 79/164] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:35.441824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677b4d0-eedf-4df7-938e-cc6d11f8bd4a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:35.537214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 86/165] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:35.620607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:35.627336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677b4d0-eedf-4df7-938e-cc6d11f8bd4a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:35.685346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2ef9-3a8c-4fb8-8817-bf29eb9dc3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:35.685976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2ef9-3a8c-4fb8-8817-bf29eb9dc3fe None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:35.686253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2ef9-3a8c-4fb8-8817-bf29eb9dc3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:35.686524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2ef9-3a8c-4fb8-8817-bf29eb9dc3fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:35.794457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b2ef9-3a8c-4fb8-8817-bf29eb9dc3fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:35.795988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b2ef9-3a8c-4fb8-8817-bf29eb9dc3fe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:35.940143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:35.948183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 80/166] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:35.954239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66754b79-7643-427b-8c5a-86105b807ba9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:36.102473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66754b79-7643-427b-8c5a-86105b807ba9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:36.151652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb36826-2f7e-4ab1-8a08-16e1e5728be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:36.152295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb36826-2f7e-4ab1-8a08-16e1e5728be9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:36.152630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb36826-2f7e-4ab1-8a08-16e1e5728be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:36.152911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb36826-2f7e-4ab1-8a08-16e1e5728be9 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:36.154084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb36826-2f7e-4ab1-8a08-16e1e5728be9 None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:36.155574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb36826-2f7e-4ab1-8a08-16e1e5728be9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:36.158015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 87/167] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:35 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:36.164258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2ef9-3a8c-4fb8-8817-bf29eb9dc3fe None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:36.178482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb36826-2f7e-4ab1-8a08-16e1e5728be9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:36.228940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:36.378021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb36826-2f7e-4ab1-8a08-16e1e5728be9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:36.394952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2ef9-3a8c-4fb8-8817-bf29eb9dc3fe None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:36.430150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9e4b-9ca0-454f-b638-55b34f6c9bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:36.430925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9e4b-9ca0-454f-b638-55b34f6c9bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:36.431381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9e4b-9ca0-454f-b638-55b34f6c9bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:36.431662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9e4b-9ca0-454f-b638-55b34f6c9bb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:36.451226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f9e4b-9ca0-454f-b638-55b34f6c9bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-754f9e4b-9ca0-454f-b638-55b34f6c9bb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:36.456175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:36.457201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:36.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:36.460838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 88/168] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:36.460838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9e4b-9ca0-454f-b638-55b34f6c9bb3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:36.477471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da88b3-31df-4b2b-9aab-3ff62fc49c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:36.478096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da88b3-31df-4b2b-9aab-3ff62fc49c23 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:36.478378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da88b3-31df-4b2b-9aab-3ff62fc49c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:36.478646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da88b3-31df-4b2b-9aab-3ff62fc49c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:36.479416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da88b3-31df-4b2b-9aab-3ff62fc49c23 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008, user.id=e9cbf2d8bf704c83aab7f97b0095bb79) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:36.479729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da88b3-31df-4b2b-9aab-3ff62fc49c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:36.481206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da88b3-31df-4b2b-9aab-3ff62fc49c23 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:36.499288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 81/169] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:36 2022] GET /identity/v3/role_assignments?user.id=e9cbf2d8bf704c83aab7f97b0095bb79&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:36.500191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da88b3-31df-4b2b-9aab-3ff62fc49c23 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:36.642925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:36.679800 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:36.704767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9e4b-9ca0-454f-b638-55b34f6c9bb3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:36.754709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da88b3-31df-4b2b-9aab-3ff62fc49c23 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:36.760437 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171c7ea-6e04-44e5-aec7-ece5f0fa9d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:36.761144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171c7ea-6e04-44e5-aec7-ece5f0fa9d78 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:36.761426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171c7ea-6e04-44e5-aec7-ece5f0fa9d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:36.761700 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171c7ea-6e04-44e5-aec7-ece5f0fa9d78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:36.774586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171c7ea-6e04-44e5-aec7-ece5f0fa9d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2171c7ea-6e04-44e5-aec7-ece5f0fa9d78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:36.783729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:36.784654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:36.785521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 89/170] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:20:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:36.794201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171c7ea-6e04-44e5-aec7-ece5f0fa9d78 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:36.847428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757642f-dbb0-4589-8843-b330dfcfeca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:36.848076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757642f-dbb0-4589-8843-b330dfcfeca1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:36.848369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757642f-dbb0-4589-8843-b330dfcfeca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:36.848648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757642f-dbb0-4589-8843-b330dfcfeca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:36.849348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757642f-dbb0-4589-8843-b330dfcfeca1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:36.849663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757642f-dbb0-4589-8843-b330dfcfeca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:36.851398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757642f-dbb0-4589-8843-b330dfcfeca1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:36.870914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 82/171] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:36.877293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757642f-dbb0-4589-8843-b330dfcfeca1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:36.925974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171c7ea-6e04-44e5-aec7-ece5f0fa9d78 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:36.974067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160056d-073a-4d69-b001-d6762ac1cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:36.974763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160056d-073a-4d69-b001-d6762ac1cdfa None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:36.975044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160056d-073a-4d69-b001-d6762ac1cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:36.975315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160056d-073a-4d69-b001-d6762ac1cdfa None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:36.976578 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160056d-073a-4d69-b001-d6762ac1cdfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:36.976870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160056d-073a-4d69-b001-d6762ac1cdfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:36.983314 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160056d-073a-4d69-b001-d6762ac1cdfa None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:36.992958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 90/172] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:20:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:37.005607 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4686fa-6e34-41db-b8ee-f962b4c77061 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:37.005914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4686fa-6e34-41db-b8ee-f962b4c77061 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:37.006212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4686fa-6e34-41db-b8ee-f962b4c77061 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:37.008425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 91/173] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:37.015418 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4686fa-6e34-41db-b8ee-f962b4c77061 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:37.016261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:37.089345 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757642f-dbb0-4589-8843-b330dfcfeca1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:37.114172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:37.139901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766928a-291e-404a-a681-c3a4979f0ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:37.140909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766928a-291e-404a-a681-c3a4979f0ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:37.142240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766928a-291e-404a-a681-c3a4979f0ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:37.143774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766928a-291e-404a-a681-c3a4979f0ef0 None admin] PATH_INFO: `/v3/users/5b8bc8c97d8b42988e9534a42c6e4196` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:37.147450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766928a-291e-404a-a681-c3a4979f0ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=5b8bc8c97d8b42988e9534a42c6e4196)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:37.149224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766928a-291e-404a-a681-c3a4979f0ef0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:37.154403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 83/174] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:36 2022] GET /identity/v3/users/5b8bc8c97d8b42988e9534a42c6e4196 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:37.155985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f01b-c198-4be6-8b92-3f77862fede0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:37.157724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f01b-c198-4be6-8b92-3f77862fede0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:37.159073 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f01b-c198-4be6-8b92-3f77862fede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:37.193893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6086f01b-c198-4be6-8b92-3f77862fede0 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:37.195241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6086f01b-c198-4be6-8b92-3f77862fede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:37.208770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4686fa-6e34-41db-b8ee-f962b4c77061 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:37.251586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71b3f7-1e81-4158-990f-fc333812cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:37.252990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71b3f7-1e81-4158-990f-fc333812cc2c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:37.253472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71b3f7-1e81-4158-990f-fc333812cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:37.253943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71b3f7-1e81-4158-990f-fc333812cc2c None admin] PATH_INFO: `/v3/users/5b8bc8c97d8b42988e9534a42c6e4196` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:37.255357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71b3f7-1e81-4158-990f-fc333812cc2c None admin] RBAC: Authorizing `identity:get_user(user_id=5b8bc8c97d8b42988e9534a42c6e4196)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:37.257331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71b3f7-1e81-4158-990f-fc333812cc2c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:37.259601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 92/175] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:37 2022] GET /identity/v3/users/5b8bc8c97d8b42988e9534a42c6e4196 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:37.261114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71b3f7-1e81-4158-990f-fc333812cc2c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:37.343148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:37.366497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 84/176] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:37.374707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f01b-c198-4be6-8b92-3f77862fede0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:37.396327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71b3f7-1e81-4158-990f-fc333812cc2c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:37.454301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f8de7-5583-4dbf-81c4-96932ee1104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:37.455459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f8de7-5583-4dbf-81c4-96932ee1104b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:37.455989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f8de7-5583-4dbf-81c4-96932ee1104b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:37.456472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f8de7-5583-4dbf-81c4-96932ee1104b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:37.567238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f8de7-5583-4dbf-81c4-96932ee1104b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:37.568727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f8de7-5583-4dbf-81c4-96932ee1104b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:37.625010 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f01b-c198-4be6-8b92-3f77862fede0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:37.651369 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:37.674698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:37.690882 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 93/177] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:37.697925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f8de7-5583-4dbf-81c4-96932ee1104b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:37.711665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e938c4a-5b71-48e8-b4d8-0c869c0f8569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:37.712222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938c4a-5b71-48e8-b4d8-0c869c0f8569 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:37.712508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938c4a-5b71-48e8-b4d8-0c869c0f8569 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:37.712784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938c4a-5b71-48e8-b4d8-0c869c0f8569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:37.812519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f8de7-5583-4dbf-81c4-96932ee1104b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:37.853530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d6593-578c-4922-9f82-84515965d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:37.854575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d6593-578c-4922-9f82-84515965d967 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:37.855025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d6593-578c-4922-9f82-84515965d967 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:37.855519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d6593-578c-4922-9f82-84515965d967 None admin] PATH_INFO: `/v3/projects/dade56232c384d2d9bbeb826e849e4bc` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:37.863908 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d6593-578c-4922-9f82-84515965d967 None admin] RBAC: Authorizing `identity:get_project(project_id=dade56232c384d2d9bbeb826e849e4bc)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:37.865732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d6593-578c-4922-9f82-84515965d967 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:37.867267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e938c4a-5b71-48e8-b4d8-0c869c0f8569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:37.868998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e938c4a-5b71-48e8-b4d8-0c869c0f8569 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:37.873429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 94/178] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:37 2022] GET /identity/v3/projects/dade56232c384d2d9bbeb826e849e4bc => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:37.874911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8bc64-2599-476d-98ae-de47e0186b4a None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:37.875354 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8bc64-2599-476d-98ae-de47e0186b4a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:37.876001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8bc64-2599-476d-98ae-de47e0186b4a None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:37.878191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 95/179] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:37.879403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8bc64-2599-476d-98ae-de47e0186b4a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:37.956087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:38.009337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 85/180] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:38.010790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16431a-bb3a-4fdc-b1d3-ea2737e1df06 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.011072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16431a-bb3a-4fdc-b1d3-ea2737e1df06 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.011339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16431a-bb3a-4fdc-b1d3-ea2737e1df06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.024568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8bc64-2599-476d-98ae-de47e0186b4a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:38.028898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cc16431a-bb3a-4fdc-b1d3-ea2737e1df06 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:38.030078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cc16431a-bb3a-4fdc-b1d3-ea2737e1df06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:38.043647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:38.059069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884f02a-de3f-46c0-b9af-44b19ef62765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:38.059669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f02a-de3f-46c0-b9af-44b19ef62765 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.059944 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f02a-de3f-46c0-b9af-44b19ef62765 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.060211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f02a-de3f-46c0-b9af-44b19ef62765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.060926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f02a-de3f-46c0-b9af-44b19ef62765 None admin] RBAC: Adding query filter params (role.id=adb2774e1d254454a97fab85c6000155, scope.project.id=dade56232c384d2d9bbeb826e849e4bc, user.id=5b8bc8c97d8b42988e9534a42c6e4196) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:38.061232 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f02a-de3f-46c0-b9af-44b19ef62765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:38.062647 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f02a-de3f-46c0-b9af-44b19ef62765 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:38.068411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 96/181] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:37 2022] GET /identity/v3/role_assignments?user.id=5b8bc8c97d8b42988e9534a42c6e4196&scope.project.id=dade56232c384d2d9bbeb826e849e4bc&role.id=adb2774e1d254454a97fab85c6000155 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:38.068411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884f02a-de3f-46c0-b9af-44b19ef62765 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:38.100582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 86/182] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:38.103039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c4aa-57fa-4f66-aaf2-9889a7e524c6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.103317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c4aa-57fa-4f66-aaf2-9889a7e524c6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.104440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c4aa-57fa-4f66-aaf2-9889a7e524c6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.105775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 87/183] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:38.110767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3cca4-edf2-4796-9e16-dd066b2d769f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.111040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3cca4-edf2-4796-9e16-dd066b2d769f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.111437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3cca4-edf2-4796-9e16-dd066b2d769f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.113154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 88/184] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:38.113967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3cca4-edf2-4796-9e16-dd066b2d769f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:38.206864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884f02a-de3f-46c0-b9af-44b19ef62765 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:38.208493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:38.245914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b197648-3f2b-477b-8d89-253657f2c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:38.246560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197648-3f2b-477b-8d89-253657f2c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.246873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197648-3f2b-477b-8d89-253657f2c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.247146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197648-3f2b-477b-8d89-253657f2c5a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.254725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3cca4-edf2-4796-9e16-dd066b2d769f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:38.259327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b197648-3f2b-477b-8d89-253657f2c5a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-1b197648-3f2b-477b-8d89-253657f2c5a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:38.264465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:38.265517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:38.266345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 97/185] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:20:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:38.267048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba17619-31e5-4a8e-86ed-0a6153a64356 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.267120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba17619-31e5-4a8e-86ed-0a6153a64356 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.267453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba17619-31e5-4a8e-86ed-0a6153a64356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.287821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dba17619-31e5-4a8e-86ed-0a6153a64356 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:38.289740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dba17619-31e5-4a8e-86ed-0a6153a64356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:38.298122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d3f39-9053-4b85-9a48-5d0e5fab1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:38.298789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d3f39-9053-4b85-9a48-5d0e5fab1761 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.299072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d3f39-9053-4b85-9a48-5d0e5fab1761 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.299344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d3f39-9053-4b85-9a48-5d0e5fab1761 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.300735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d3f39-9053-4b85-9a48-5d0e5fab1761 None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:38.302186 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d3f39-9053-4b85-9a48-5d0e5fab1761 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:38.304069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 89/186] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:38 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:38.305271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78107e-2328-460e-be6a-412297c11d35 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.305556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78107e-2328-460e-be6a-412297c11d35 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.305831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78107e-2328-460e-be6a-412297c11d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.324808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bb78107e-2328-460e-be6a-412297c11d35 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:38.326005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bb78107e-2328-460e-be6a-412297c11d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:38.347063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:38.375667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 98/187] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:38.376540 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba17619-31e5-4a8e-86ed-0a6153a64356 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:38.419452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 90/188] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:38.426713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78107e-2328-460e-be6a-412297c11d35 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:38.532510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:38.542201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78107e-2328-460e-be6a-412297c11d35 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:38.547117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba17619-31e5-4a8e-86ed-0a6153a64356 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:38.579084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa3aad-3d07-4bad-a38d-9327518a68b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:38.579847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa3aad-3d07-4bad-a38d-9327518a68b6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.580195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa3aad-3d07-4bad-a38d-9327518a68b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.580530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa3aad-3d07-4bad-a38d-9327518a68b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.581318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa3aad-3d07-4bad-a38d-9327518a68b6 None admin] RBAC: Adding query filter params (role.id=8bc105194aae4f11b5a2b917bb621f1f, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008, user.id=5b8bc8c97d8b42988e9534a42c6e4196) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:38.581693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa3aad-3d07-4bad-a38d-9327518a68b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:38.583247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa3aad-3d07-4bad-a38d-9327518a68b6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:38.590130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 91/189] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:38 2022] GET /identity/v3/role_assignments?user.id=5b8bc8c97d8b42988e9534a42c6e4196&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=8bc105194aae4f11b5a2b917bb621f1f => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:38.590493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53eb0c7-4552-4a6b-8aeb-f394bec2d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:38.590855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa3aad-3d07-4bad-a38d-9327518a68b6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:38.591130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eb0c7-4552-4a6b-8aeb-f394bec2d263 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.591410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eb0c7-4552-4a6b-8aeb-f394bec2d263 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.591680 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eb0c7-4552-4a6b-8aeb-f394bec2d263 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.592342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53eb0c7-4552-4a6b-8aeb-f394bec2d263 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:38.592689 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53eb0c7-4552-4a6b-8aeb-f394bec2d263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:38.595424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53eb0c7-4552-4a6b-8aeb-f394bec2d263 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:38.607707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:38.608186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 99/190] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:38.615289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53eb0c7-4552-4a6b-8aeb-f394bec2d263 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:38.737936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa3aad-3d07-4bad-a38d-9327518a68b6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:38.739963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53eb0c7-4552-4a6b-8aeb-f394bec2d263 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:38.775904 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29277a68-e085-40a8-83fd-6e4fe4fd3e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:38.776561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277a68-e085-40a8-83fd-6e4fe4fd3e7e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.776835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277a68-e085-40a8-83fd-6e4fe4fd3e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.777104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277a68-e085-40a8-83fd-6e4fe4fd3e7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.781154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e6ec0-aef0-4e69-980b-eeda0e536e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:38.781817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e6ec0-aef0-4e69-980b-eeda0e536e10 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.782093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e6ec0-aef0-4e69-980b-eeda0e536e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.782358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e6ec0-aef0-4e69-980b-eeda0e536e10 None admin] PATH_INFO: `/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.789085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29277a68-e085-40a8-83fd-6e4fe4fd3e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-29277a68-e085-40a8-83fd-6e4fe4fd3e7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:38.794500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:38.795462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:38.796263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 92/191] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:38.800189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e6ec0-aef0-4e69-980b-eeda0e536e10 None admin] RBAC: Authorizing `identity:get_user(user_id=0fcd1fe79dfb4e4cbd57c8864e9a7746)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:38.801665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29277a68-e085-40a8-83fd-6e4fe4fd3e7e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:38.802243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e6ec0-aef0-4e69-980b-eeda0e536e10 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:38.804711 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 100/192] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:38 2022] GET /identity/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:38.805621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e6ec0-aef0-4e69-980b-eeda0e536e10 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:38.822138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:38.891211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:38.920671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e6ec0-aef0-4e69-980b-eeda0e536e10 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:38.921946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29277a68-e085-40a8-83fd-6e4fe4fd3e7e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:38.954150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8fa1d-c235-4ca4-8db4-d1379e22b921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:38.954808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8fa1d-c235-4ca4-8db4-d1379e22b921 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.954959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c1500-f5dc-41ab-b8e5-a6e0963f6279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:38.955082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8fa1d-c235-4ca4-8db4-d1379e22b921 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.955337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8fa1d-c235-4ca4-8db4-d1379e22b921 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.955556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1500-f5dc-41ab-b8e5-a6e0963f6279 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:38.955833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1500-f5dc-41ab-b8e5-a6e0963f6279 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:38.956098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1500-f5dc-41ab-b8e5-a6e0963f6279 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:38.957190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c1500-f5dc-41ab-b8e5-a6e0963f6279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:38.958627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c1500-f5dc-41ab-b8e5-a6e0963f6279 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:38.960955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 101/193] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:38.961544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c1500-f5dc-41ab-b8e5-a6e0963f6279 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:38.967501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8fa1d-c235-4ca4-8db4-d1379e22b921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8ea8fa1d-c235-4ca4-8db4-d1379e22b921 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:38.972755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:38.973653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:38.974445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 93/194] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:20:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:38.975124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8fa1d-c235-4ca4-8db4-d1379e22b921 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:39.044921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:39.064075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c1500-f5dc-41ab-b8e5-a6e0963f6279 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:39.074402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8fa1d-c235-4ca4-8db4-d1379e22b921 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:39.096592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db82720-9dfc-4221-a272-65087dfea4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:39.097507 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db82720-9dfc-4221-a272-65087dfea4cc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:39.097788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db82720-9dfc-4221-a272-65087dfea4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:39.098060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db82720-9dfc-4221-a272-65087dfea4cc None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:39.098744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db82720-9dfc-4221-a272-65087dfea4cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:39.099049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db82720-9dfc-4221-a272-65087dfea4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:39.100412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db82720-9dfc-4221-a272-65087dfea4cc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:39.103135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:39.108671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795576e7-51d4-4ed4-aaf7-3799612d0d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:39.109184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 102/195] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:39.109304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795576e7-51d4-4ed4-aaf7-3799612d0d78 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:39.109545 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795576e7-51d4-4ed4-aaf7-3799612d0d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:39.109814 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795576e7-51d4-4ed4-aaf7-3799612d0d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:39.109975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db82720-9dfc-4221-a272-65087dfea4cc None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:39.175687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795576e7-51d4-4ed4-aaf7-3799612d0d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:39.177168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795576e7-51d4-4ed4-aaf7-3799612d0d78 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:39.211951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db82720-9dfc-4221-a272-65087dfea4cc None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:39.244842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ca3e8-b637-4678-9f76-fa19dcf5e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:39.245446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ca3e8-b637-4678-9f76-fa19dcf5e139 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:39.245729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ca3e8-b637-4678-9f76-fa19dcf5e139 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:39.246004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ca3e8-b637-4678-9f76-fa19dcf5e139 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:39.246663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ca3e8-b637-4678-9f76-fa19dcf5e139 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:39.248133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ca3e8-b637-4678-9f76-fa19dcf5e139 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:39.265144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:39.271678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 103/196] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:20:39 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:39.273408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ca3e8-b637-4678-9f76-fa19dcf5e139 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:39.275372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 94/197] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:39.276242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795576e7-51d4-4ed4-aaf7-3799612d0d78 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:39.313602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:39.394721 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ca3e8-b637-4678-9f76-fa19dcf5e139 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:39.394973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795576e7-51d4-4ed4-aaf7-3799612d0d78 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:39.434856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdb31a-a1a4-4271-917b-3c50568a0f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:39.435081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3225-45e7-4bb0-a222-d8bfaa7dff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:39.435820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdb31a-a1a4-4271-917b-3c50568a0f8c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:39.435955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3225-45e7-4bb0-a222-d8bfaa7dff35 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:39.436050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdb31a-a1a4-4271-917b-3c50568a0f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:39.436141 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdb31a-a1a4-4271-917b-3c50568a0f8c None admin] PATH_INFO: `/v3/users/18472e7f3a9e420e9997a069c0d71656` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:39.436465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3225-45e7-4bb0-a222-d8bfaa7dff35 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:39.436725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3225-45e7-4bb0-a222-d8bfaa7dff35 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:39.437333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdb31a-a1a4-4271-917b-3c50568a0f8c None admin] RBAC: Authorizing `identity:get_user(user_id=18472e7f3a9e420e9997a069c0d71656)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:39.437615 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c3225-45e7-4bb0-a222-d8bfaa7dff35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:39.437988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c3225-45e7-4bb0-a222-d8bfaa7dff35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:39.439418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdb31a-a1a4-4271-917b-3c50568a0f8c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:39.439586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c3225-45e7-4bb0-a222-d8bfaa7dff35 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:39.446303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 95/198] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:39 2022] GET /identity/v3/users/18472e7f3a9e420e9997a069c0d71656 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:39.447283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdb31a-a1a4-4271-917b-3c50568a0f8c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:39.455915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 104/199] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:20:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:39.455915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3225-45e7-4bb0-a222-d8bfaa7dff35 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:39.527140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:39.582460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:39.584113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3225-45e7-4bb0-a222-d8bfaa7dff35 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:39.589647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdb31a-a1a4-4271-917b-3c50568a0f8c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:39.630542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18facfeb-ec52-4ac2-8902-d790afeebec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:39.631356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18facfeb-ec52-4ac2-8902-d790afeebec5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:39.631731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18facfeb-ec52-4ac2-8902-d790afeebec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:39.633250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94619bd-ccaf-436a-b0aa-5b54760581f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:39.633716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18facfeb-ec52-4ac2-8902-d790afeebec5 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:39.633874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94619bd-ccaf-436a-b0aa-5b54760581f6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:39.634156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94619bd-ccaf-436a-b0aa-5b54760581f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:39.634436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94619bd-ccaf-436a-b0aa-5b54760581f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:39.635327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18facfeb-ec52-4ac2-8902-d790afeebec5 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:39.637566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18facfeb-ec52-4ac2-8902-d790afeebec5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:39.639568 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 96/200] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:39 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:39.639568 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18facfeb-ec52-4ac2-8902-d790afeebec5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:39.734634 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94619bd-ccaf-436a-b0aa-5b54760581f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:39.736417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94619bd-ccaf-436a-b0aa-5b54760581f6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:39.758375 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18facfeb-ec52-4ac2-8902-d790afeebec5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:39.794664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103b143-a3bf-43a0-9b95-82f73d4e9fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:39.795482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103b143-a3bf-43a0-9b95-82f73d4e9fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:39.796255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103b143-a3bf-43a0-9b95-82f73d4e9fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:39.796255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103b143-a3bf-43a0-9b95-82f73d4e9fa3 None admin] PATH_INFO: `/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:39.797595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103b143-a3bf-43a0-9b95-82f73d4e9fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=0fcd1fe79dfb4e4cbd57c8864e9a7746)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:39.799167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103b143-a3bf-43a0-9b95-82f73d4e9fa3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:39.806699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 97/201] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:39 2022] GET /identity/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:39.806699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103b143-a3bf-43a0-9b95-82f73d4e9fa3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:39.809290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:39.842051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:39.858328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 105/202] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:39.859553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94619bd-ccaf-436a-b0aa-5b54760581f6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:39.918820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103b143-a3bf-43a0-9b95-82f73d4e9fa3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:39.963122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6487fcf-e674-42e8-9af9-16da6ae20b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:39.963890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6487fcf-e674-42e8-9af9-16da6ae20b01 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:39.964266 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6487fcf-e674-42e8-9af9-16da6ae20b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:39.964668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6487fcf-e674-42e8-9af9-16da6ae20b01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:39.965495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6487fcf-e674-42e8-9af9-16da6ae20b01 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=fdf4e0e74ba94622a91171159045ae6d, user.id=0fcd1fe79dfb4e4cbd57c8864e9a7746) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:39.965929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6487fcf-e674-42e8-9af9-16da6ae20b01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:39.967603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6487fcf-e674-42e8-9af9-16da6ae20b01 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:39.973886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 98/203] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:39 2022] GET /identity/v3/role_assignments?user.id=0fcd1fe79dfb4e4cbd57c8864e9a7746&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:39.974733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6487fcf-e674-42e8-9af9-16da6ae20b01 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:39.979509 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94619bd-ccaf-436a-b0aa-5b54760581f6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:40.074210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc40e-bf90-4c31-af82-781d80415d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:40.075837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc40e-bf90-4c31-af82-781d80415d86 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:40.077254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc40e-bf90-4c31-af82-781d80415d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:40.077671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc40e-bf90-4c31-af82-781d80415d86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:40.125256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:40.138934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:40.142386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6487fcf-e674-42e8-9af9-16da6ae20b01 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:40.212984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee3fec-26d7-4e8f-9b44-e268a2d8bc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:40.214006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee3fec-26d7-4e8f-9b44-e268a2d8bc8e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:40.214555 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee3fec-26d7-4e8f-9b44-e268a2d8bc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:40.215207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee3fec-26d7-4e8f-9b44-e268a2d8bc8e None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:40.217759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee3fec-26d7-4e8f-9b44-e268a2d8bc8e None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:40.220741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee3fec-26d7-4e8f-9b44-e268a2d8bc8e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:40.221765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc40e-bf90-4c31-af82-781d80415d86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:40.223478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc40e-bf90-4c31-af82-781d80415d86 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:40.230873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 99/204] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:39 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:40.235983 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee3fec-26d7-4e8f-9b44-e268a2d8bc8e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:40.382250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 106/205] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:40.392251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc40e-bf90-4c31-af82-781d80415d86 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:40.414278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee3fec-26d7-4e8f-9b44-e268a2d8bc8e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:40.452139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee96f6-11f2-4543-a533-072c79a81e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:40.452754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee96f6-11f2-4543-a533-072c79a81e8c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:40.453041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee96f6-11f2-4543-a533-072c79a81e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:40.453313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee96f6-11f2-4543-a533-072c79a81e8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:40.454047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee96f6-11f2-4543-a533-072c79a81e8c None admin] RBAC: Adding query filter params (role.id=af54b7a166d9431c8f6a2fde986f4cda, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008, user.id=18472e7f3a9e420e9997a069c0d71656) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:40.454356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee96f6-11f2-4543-a533-072c79a81e8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:40.464140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee96f6-11f2-4543-a533-072c79a81e8c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:40.470633 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 100/206] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:40 2022] GET /identity/v3/role_assignments?user.id=18472e7f3a9e420e9997a069c0d71656&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=af54b7a166d9431c8f6a2fde986f4cda => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:40.511219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:40.580139 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc40e-bf90-4c31-af82-781d80415d86 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:40.631162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5a5ab-acd5-486a-9b54-65aaf3d882d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:40.632661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5a5ab-acd5-486a-9b54-65aaf3d882d1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:40.633092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5a5ab-acd5-486a-9b54-65aaf3d882d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:40.633509 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5a5ab-acd5-486a-9b54-65aaf3d882d1 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:40.639567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5a5ab-acd5-486a-9b54-65aaf3d882d1 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:40.641331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5a5ab-acd5-486a-9b54-65aaf3d882d1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:40.643291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 107/207] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:40 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:40.649461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee96f6-11f2-4543-a533-072c79a81e8c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:40.691061 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:40.768895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee96f6-11f2-4543-a533-072c79a81e8c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:40.809296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52981d0c-0d29-4ee5-8809-4830970a3649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:40.809962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981d0c-0d29-4ee5-8809-4830970a3649 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:40.810243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981d0c-0d29-4ee5-8809-4830970a3649 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:40.810516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981d0c-0d29-4ee5-8809-4830970a3649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:40.811319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52981d0c-0d29-4ee5-8809-4830970a3649 None admin] RBAC: Adding query filter params (role.id=8bc105194aae4f11b5a2b917bb621f1f, scope.project.id=fdf4e0e74ba94622a91171159045ae6d, user.id=0fcd1fe79dfb4e4cbd57c8864e9a7746) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:40.811636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52981d0c-0d29-4ee5-8809-4830970a3649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:40.813105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52981d0c-0d29-4ee5-8809-4830970a3649 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:40.819831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 101/208] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:40 2022] GET /identity/v3/role_assignments?user.id=0fcd1fe79dfb4e4cbd57c8864e9a7746&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=8bc105194aae4f11b5a2b917bb621f1f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:41.774627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456c9b-85fd-40a0-abc9-e8ed05aa3ee8 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:41.775156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456c9b-85fd-40a0-abc9-e8ed05aa3ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:41.775156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456c9b-85fd-40a0-abc9-e8ed05aa3ee8 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:41.776475 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 108/209] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:41.781820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b01a3-8714-4b6e-bb5f-22e77e38490b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:41.782207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b01a3-8714-4b6e-bb5f-22e77e38490b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:41.782374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b01a3-8714-4b6e-bb5f-22e77e38490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:41.802591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-912b01a3-8714-4b6e-bb5f-22e77e38490b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:41.803948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-912b01a3-8714-4b6e-bb5f-22e77e38490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:41.834397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258b3b-35ed-458d-b10c-5854b40b4c3d None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:41.834721 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258b3b-35ed-458d-b10c-5854b40b4c3d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:41.835541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258b3b-35ed-458d-b10c-5854b40b4c3d None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:41.837325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 109/210] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:41.842527 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2df2bb-79da-40af-89f2-317261de1314 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:41.842840 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2df2bb-79da-40af-89f2-317261de1314 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:41.843115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2df2bb-79da-40af-89f2-317261de1314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:41.861574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bb2df2bb-79da-40af-89f2-317261de1314 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:41.863100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bb2df2bb-79da-40af-89f2-317261de1314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:41.887192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 102/211] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:41.938843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 110/212] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:42.180981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b01a3-8714-4b6e-bb5f-22e77e38490b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:42.201126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2df2bb-79da-40af-89f2-317261de1314 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:42.215466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:42.266143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:42.305132 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b01a3-8714-4b6e-bb5f-22e77e38490b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:42.315397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2df2bb-79da-40af-89f2-317261de1314 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:42.342978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13325e8d-5a71-4a13-8e1e-a17eb3aeccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:42.343617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13325e8d-5a71-4a13-8e1e-a17eb3aeccd0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:42.343899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13325e8d-5a71-4a13-8e1e-a17eb3aeccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:42.344175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13325e8d-5a71-4a13-8e1e-a17eb3aeccd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:42.354001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a6021-a9c3-4cf0-bf83-7f00ae724419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:42.354797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a6021-a9c3-4cf0-bf83-7f00ae724419 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:42.355146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a6021-a9c3-4cf0-bf83-7f00ae724419 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:42.355488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a6021-a9c3-4cf0-bf83-7f00ae724419 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:42.355605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13325e8d-5a71-4a13-8e1e-a17eb3aeccd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:42.356751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a6021-a9c3-4cf0-bf83-7f00ae724419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:42.358272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a6021-a9c3-4cf0-bf83-7f00ae724419 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:42.360027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 111/213] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-13325e8d-5a71-4a13-8e1e-a17eb3aeccd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:42.360908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:42.361962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:42.363016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:42.364011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 103/214] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:42.370415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a6021-a9c3-4cf0-bf83-7f00ae724419 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:42.371786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13325e8d-5a71-4a13-8e1e-a17eb3aeccd0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:42.487043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:42.499922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a6021-a9c3-4cf0-bf83-7f00ae724419 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:42.514239 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13325e8d-5a71-4a13-8e1e-a17eb3aeccd0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:42.529353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:42.541284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d379b0a-bd8e-4ef9-83c0-e159e4825ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:42.542327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d379b0a-bd8e-4ef9-83c0-e159e4825ab7 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:42.542908 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d379b0a-bd8e-4ef9-83c0-e159e4825ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:42.543279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d379b0a-bd8e-4ef9-83c0-e159e4825ab7 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:42.543948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d379b0a-bd8e-4ef9-83c0-e159e4825ab7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:42.546331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d379b0a-bd8e-4ef9-83c0-e159e4825ab7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:42.549726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc24ce-8057-4f2a-b6af-96c758be29a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:42.550337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc24ce-8057-4f2a-b6af-96c758be29a5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:42.550910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc24ce-8057-4f2a-b6af-96c758be29a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:42.551184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc24ce-8057-4f2a-b6af-96c758be29a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:42.551850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc24ce-8057-4f2a-b6af-96c758be29a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:42.552155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc24ce-8057-4f2a-b6af-96c758be29a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:42.553520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc24ce-8057-4f2a-b6af-96c758be29a5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:42.562890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 104/215] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:42.569017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d5e6-cb44-4853-a07d-9bcfd3700602 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:42.569565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d5e6-cb44-4853-a07d-9bcfd3700602 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:42.569878 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d5e6-cb44-4853-a07d-9bcfd3700602 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:42.571430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 105/216] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:42.574795 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36d5e6-cb44-4853-a07d-9bcfd3700602 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:42.578766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 112/217] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:20:42 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:42.580310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f369-a1da-41c8-80ff-712ae2e3f1c7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:42.580617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f369-a1da-41c8-80ff-712ae2e3f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:42.580893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f369-a1da-41c8-80ff-712ae2e3f1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:42.602523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3b25f369-a1da-41c8-80ff-712ae2e3f1c7 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:42.606914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3b25f369-a1da-41c8-80ff-712ae2e3f1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:42.708223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 113/218] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:42.712381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36d5e6-cb44-4853-a07d-9bcfd3700602 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:42.752167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd3baa-883f-4731-a53c-cdf52a1f9411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:42.753179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd3baa-883f-4731-a53c-cdf52a1f9411 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:42.753660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd3baa-883f-4731-a53c-cdf52a1f9411 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:42.754127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd3baa-883f-4731-a53c-cdf52a1f9411 None admin] PATH_INFO: `/v3/users/13a122235e9f42af98fd3ad7ad11bf8a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:42.770913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd3baa-883f-4731-a53c-cdf52a1f9411 None admin] RBAC: Authorizing `identity:get_user(user_id=13a122235e9f42af98fd3ad7ad11bf8a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:42.773229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd3baa-883f-4731-a53c-cdf52a1f9411 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:42.775469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 106/219] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:42 2022] GET /identity/v3/users/13a122235e9f42af98fd3ad7ad11bf8a => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:42.781183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f369-a1da-41c8-80ff-712ae2e3f1c7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:42.887326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f369-a1da-41c8-80ff-712ae2e3f1c7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:42.905252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:42.931360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac44c32-c784-4857-aada-5e14192bb5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:42.932006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44c32-c784-4857-aada-5e14192bb5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:42.932288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44c32-c784-4857-aada-5e14192bb5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:42.932562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44c32-c784-4857-aada-5e14192bb5f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:42.982896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd3baa-883f-4731-a53c-cdf52a1f9411 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:42.994735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:43.014996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac44c32-c784-4857-aada-5e14192bb5f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:43.016353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac44c32-c784-4857-aada-5e14192bb5f4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:43.131329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 114/220] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:43.133146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23f47-45d5-4c2d-8a0f-f2b2db56c1e9 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:43.133422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23f47-45d5-4c2d-8a0f-f2b2db56c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:43.133701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23f47-45d5-4c2d-8a0f-f2b2db56c1e9 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:43.135214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 115/221] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:43.136033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd3baa-883f-4731-a53c-cdf52a1f9411 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:43.139885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e23f47-45d5-4c2d-8a0f-f2b2db56c1e9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:43.156140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:43.184981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b14a4-049a-41e8-ae56-64772937b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:43.186524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b14a4-049a-41e8-ae56-64772937b80b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:43.187053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b14a4-049a-41e8-ae56-64772937b80b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:43.187971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b14a4-049a-41e8-ae56-64772937b80b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:43.203115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b14a4-049a-41e8-ae56-64772937b80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b70b14a4-049a-41e8-ae56-64772937b80b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:43.212656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:43.213556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:43.214379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:43.216450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 107/222] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:20:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:43.221659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875663ac-aa69-41fc-8fe8-cb8af3e7d985 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:43.221659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875663ac-aa69-41fc-8fe8-cb8af3e7d985 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:43.221659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875663ac-aa69-41fc-8fe8-cb8af3e7d985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:43.250194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-875663ac-aa69-41fc-8fe8-cb8af3e7d985 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:43.252427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-875663ac-aa69-41fc-8fe8-cb8af3e7d985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:43.259271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e23f47-45d5-4c2d-8a0f-f2b2db56c1e9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:43.296809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e44f34-37c3-4baa-9d2b-0423408d17a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:43.297440 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e44f34-37c3-4baa-9d2b-0423408d17a4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:43.297789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e44f34-37c3-4baa-9d2b-0423408d17a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:43.298133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e44f34-37c3-4baa-9d2b-0423408d17a4 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:43.299874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e44f34-37c3-4baa-9d2b-0423408d17a4 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:43.302827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e44f34-37c3-4baa-9d2b-0423408d17a4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:43.305639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 116/223] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:43 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:43.306668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e44f34-37c3-4baa-9d2b-0423408d17a4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:43.335206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:43.346060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 108/224] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:43.347320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875663ac-aa69-41fc-8fe8-cb8af3e7d985 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:43.447978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:43.490808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e44f34-37c3-4baa-9d2b-0423408d17a4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:43.519906 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875663ac-aa69-41fc-8fe8-cb8af3e7d985 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:43.560806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d30eea-60a5-4ec6-a10c-e3a21b49ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:43.561692 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d30eea-60a5-4ec6-a10c-e3a21b49ed2d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:43.562158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d30eea-60a5-4ec6-a10c-e3a21b49ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:43.562598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d30eea-60a5-4ec6-a10c-e3a21b49ed2d None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:43.563465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d30eea-60a5-4ec6-a10c-e3a21b49ed2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:43.564094 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d30eea-60a5-4ec6-a10c-e3a21b49ed2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:43.567923 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d30eea-60a5-4ec6-a10c-e3a21b49ed2d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:43.585703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 117/225] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:43.592158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff7bf3-7bec-4be5-93da-827a47c74fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:43.593362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d30eea-60a5-4ec6-a10c-e3a21b49ed2d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:43.594535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff7bf3-7bec-4be5-93da-827a47c74fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:43.595378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff7bf3-7bec-4be5-93da-827a47c74fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:43.596785 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff7bf3-7bec-4be5-93da-827a47c74fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:43.598325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff7bf3-7bec-4be5-93da-827a47c74fd3 None admin] RBAC: Adding query filter params (role.id=adb2774e1d254454a97fab85c6000155, scope.project.id=fdf4e0e74ba94622a91171159045ae6d, user.id=13a122235e9f42af98fd3ad7ad11bf8a) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:43.599248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff7bf3-7bec-4be5-93da-827a47c74fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:43.602460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff7bf3-7bec-4be5-93da-827a47c74fd3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:43.616473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 109/226] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:43 2022] GET /identity/v3/role_assignments?user.id=13a122235e9f42af98fd3ad7ad11bf8a&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=adb2774e1d254454a97fab85c6000155 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:43.638161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff7bf3-7bec-4be5-93da-827a47c74fd3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:43.714647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:43.802096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff7bf3-7bec-4be5-93da-827a47c74fd3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:43.805088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d30eea-60a5-4ec6-a10c-e3a21b49ed2d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:43.863378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251413d-7b7b-413d-8407-0e7760be7f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:43.864286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251413d-7b7b-413d-8407-0e7760be7f81 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:43.864714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251413d-7b7b-413d-8407-0e7760be7f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:43.865131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251413d-7b7b-413d-8407-0e7760be7f81 None admin] PATH_INFO: `/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:43.866613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251413d-7b7b-413d-8407-0e7760be7f81 None admin] RBAC: Authorizing `identity:get_user(user_id=0fcd1fe79dfb4e4cbd57c8864e9a7746)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:43.868426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251413d-7b7b-413d-8407-0e7760be7f81 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:43.870347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 118/227] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:43 2022] GET /identity/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746 => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:43.876642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251413d-7b7b-413d-8407-0e7760be7f81 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:43.883225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89effc-04a6-43d8-a906-ae71827dbdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:43.883888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89effc-04a6-43d8-a906-ae71827dbdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:43.884170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89effc-04a6-43d8-a906-ae71827dbdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:43.884440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89effc-04a6-43d8-a906-ae71827dbdf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:43.895069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:43.919293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89effc-04a6-43d8-a906-ae71827dbdf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6c89effc-04a6-43d8-a906-ae71827dbdf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:43.924669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:43.926011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:43.931515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 110/228] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:20:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:43.939625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89effc-04a6-43d8-a906-ae71827dbdf9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:43.990145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251413d-7b7b-413d-8407-0e7760be7f81 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:44.025156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50e5a3-ea35-4f1d-8e85-b2b919fe0418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:44.026018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50e5a3-ea35-4f1d-8e85-b2b919fe0418 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:44.026467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50e5a3-ea35-4f1d-8e85-b2b919fe0418 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:44.026909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50e5a3-ea35-4f1d-8e85-b2b919fe0418 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:44.028176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50e5a3-ea35-4f1d-8e85-b2b919fe0418 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:44.029949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50e5a3-ea35-4f1d-8e85-b2b919fe0418 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:44.031773 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 119/229] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:43 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:44.037661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50e5a3-ea35-4f1d-8e85-b2b919fe0418 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:44.144581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:44.169804 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50e5a3-ea35-4f1d-8e85-b2b919fe0418 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:44.184024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89effc-04a6-43d8-a906-ae71827dbdf9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:44.211052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:44.220336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46fd1d-9a63-4890-a1b6-d0b2b965102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:44.221015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46fd1d-9a63-4890-a1b6-d0b2b965102e None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:44.221296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46fd1d-9a63-4890-a1b6-d0b2b965102e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:44.221573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46fd1d-9a63-4890-a1b6-d0b2b965102e None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d/users/0fcd1fe79dfb4e4cbd57c8864e9a7746/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:44.227460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87d9cb-6633-456c-9d11-b692e6a9b1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:44.227970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46fd1d-9a63-4890-a1b6-d0b2b965102e None admin] RBAC: Authorizing `identity:create_grant(project_id=fdf4e0e74ba94622a91171159045ae6d, user_id=0fcd1fe79dfb4e4cbd57c8864e9a7746, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:44.228203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87d9cb-6633-456c-9d11-b692e6a9b1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:44.228551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87d9cb-6633-456c-9d11-b692e6a9b1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:44.228890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87d9cb-6633-456c-9d11-b692e6a9b1f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:44.229423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46fd1d-9a63-4890-a1b6-d0b2b965102e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:44.229666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87d9cb-6633-456c-9d11-b692e6a9b1f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:44.230072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87d9cb-6633-456c-9d11-b692e6a9b1f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:44.231546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87d9cb-6633-456c-9d11-b692e6a9b1f5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:44.242385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 111/230] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:20:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:44.248586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87d9cb-6633-456c-9d11-b692e6a9b1f5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:44.260886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 120/231] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:20:44 2022] PUT /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d/users/0fcd1fe79dfb4e4cbd57c8864e9a7746/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:20:44.362607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87d9cb-6633-456c-9d11-b692e6a9b1f5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:44.401262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb2fc6-26ac-485b-b06c-1466a90ece94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:44.402244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb2fc6-26ac-485b-b06c-1466a90ece94 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:44.402757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb2fc6-26ac-485b-b06c-1466a90ece94 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:44.403253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb2fc6-26ac-485b-b06c-1466a90ece94 None admin] PATH_INFO: `/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:44.404593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb2fc6-26ac-485b-b06c-1466a90ece94 None admin] RBAC: Authorizing `identity:get_user(user_id=0fcd1fe79dfb4e4cbd57c8864e9a7746)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:44.406412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb2fc6-26ac-485b-b06c-1466a90ece94 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:44.408612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 112/232] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:44 2022] GET /identity/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:44.414175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46fd1d-9a63-4890-a1b6-d0b2b965102e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:44.593734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46fd1d-9a63-4890-a1b6-d0b2b965102e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:44.634560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10856892-d837-4f6b-9231-722ebae0752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:44.635620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10856892-d837-4f6b-9231-722ebae0752b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:44.636109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10856892-d837-4f6b-9231-722ebae0752b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:44.636613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10856892-d837-4f6b-9231-722ebae0752b None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:44.638117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10856892-d837-4f6b-9231-722ebae0752b None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:44.639858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10856892-d837-4f6b-9231-722ebae0752b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:44.641822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 121/233] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:44 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:44.649231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb2fc6-26ac-485b-b06c-1466a90ece94 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:44.723858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:44.807213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb2fc6-26ac-485b-b06c-1466a90ece94 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:44.855400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cec1b-d22c-453e-b981-9126000e11a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:44.856416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cec1b-d22c-453e-b981-9126000e11a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:44.856897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cec1b-d22c-453e-b981-9126000e11a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:44.857393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cec1b-d22c-453e-b981-9126000e11a0 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d/users/0fcd1fe79dfb4e4cbd57c8864e9a7746/roles/8bc105194aae4f11b5a2b917bb621f1f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:44.859898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cec1b-d22c-453e-b981-9126000e11a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdf4e0e74ba94622a91171159045ae6d, user_id=0fcd1fe79dfb4e4cbd57c8864e9a7746, role_id=8bc105194aae4f11b5a2b917bb621f1f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:44.861565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cec1b-d22c-453e-b981-9126000e11a0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:44.876788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 113/234] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:20:44 2022] PUT /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d/users/0fcd1fe79dfb4e4cbd57c8864e9a7746/roles/8bc105194aae4f11b5a2b917bb621f1f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:20:45.416753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0002c-27a8-4b99-94d5-12086793890d None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:45.417739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0002c-27a8-4b99-94d5-12086793890d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:45.418226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0002c-27a8-4b99-94d5-12086793890d None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:45.419819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 122/235] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:45.425334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fea4b-7008-4036-82db-5661088c5c83 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:45.426392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fea4b-7008-4036-82db-5661088c5c83 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:45.426925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fea4b-7008-4036-82db-5661088c5c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:45.455775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c47fea4b-7008-4036-82db-5661088c5c83 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:45.457316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c47fea4b-7008-4036-82db-5661088c5c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:45.481745 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d72b2c-1747-4f2f-af8b-35ddc8648843 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:45.482036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d72b2c-1747-4f2f-af8b-35ddc8648843 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:45.482294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d72b2c-1747-4f2f-af8b-35ddc8648843 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:45.483814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 123/236] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:45.488884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b80bed-62dc-4009-8f5d-2edec9c052fd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:45.489171 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b80bed-62dc-4009-8f5d-2edec9c052fd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:45.489448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b80bed-62dc-4009-8f5d-2edec9c052fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:45.507243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:45.519830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c1b80bed-62dc-4009-8f5d-2edec9c052fd None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:45.521036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c1b80bed-62dc-4009-8f5d-2edec9c052fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:45.582906 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 114/237] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:45.626707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 124/238] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:45.964121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fea4b-7008-4036-82db-5661088c5c83 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:46.020338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:46.032274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b80bed-62dc-4009-8f5d-2edec9c052fd None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:46.123540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fea4b-7008-4036-82db-5661088c5c83 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:46.169935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948700f2-543e-48af-a443-14dae69ae57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:46.170580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948700f2-543e-48af-a443-14dae69ae57f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:46.170881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948700f2-543e-48af-a443-14dae69ae57f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:46.171321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948700f2-543e-48af-a443-14dae69ae57f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:46.172437 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b80bed-62dc-4009-8f5d-2edec9c052fd None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:46.172558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948700f2-543e-48af-a443-14dae69ae57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:46.174268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948700f2-543e-48af-a443-14dae69ae57f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:46.177342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 115/239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:46.178626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a74e-aa7c-4971-a449-b61edd61d86c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:46.178951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a74e-aa7c-4971-a449-b61edd61d86c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:46.179224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a74e-aa7c-4971-a449-b61edd61d86c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:46.180423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 116/240] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:46.187174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10a74e-aa7c-4971-a449-b61edd61d86c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:46.215108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07447c-44f0-4d8e-87a1-2c6b5b34f31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:46.215965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07447c-44f0-4d8e-87a1-2c6b5b34f31c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:46.216382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07447c-44f0-4d8e-87a1-2c6b5b34f31c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:46.216803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07447c-44f0-4d8e-87a1-2c6b5b34f31c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:46.219891 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:46.230256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07447c-44f0-4d8e-87a1-2c6b5b34f31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-8a07447c-44f0-4d8e-87a1-2c6b5b34f31c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:46.236746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:46.237819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:46.238782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:46.240630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 125/241] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:46.248008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbbd22-d8da-4732-b435-7b59de2bb2cb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:46.248474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbbd22-d8da-4732-b435-7b59de2bb2cb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:46.248888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbbd22-d8da-4732-b435-7b59de2bb2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:46.266495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-16cbbd22-d8da-4732-b435-7b59de2bb2cb None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:46.267915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-16cbbd22-d8da-4732-b435-7b59de2bb2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:46.308398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10a74e-aa7c-4971-a449-b61edd61d86c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:46.319349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:46.354023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fadc5-f8ce-4bee-bd3e-cbe5fb655e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:46.354749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fadc5-f8ce-4bee-bd3e-cbe5fb655e3c None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:46.355030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fadc5-f8ce-4bee-bd3e-cbe5fb655e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:46.355302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fadc5-f8ce-4bee-bd3e-cbe5fb655e3c None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:46.355958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fadc5-f8ce-4bee-bd3e-cbe5fb655e3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:46.356342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 126/242] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:46.357472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbbd22-d8da-4732-b435-7b59de2bb2cb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:46.364005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fadc5-f8ce-4bee-bd3e-cbe5fb655e3c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:46.418038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 117/243] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:20:46 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:46.506306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbbd22-d8da-4732-b435-7b59de2bb2cb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:46.545676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:46.560439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74bac2-8260-4897-bb90-983023580724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:46.561067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74bac2-8260-4897-bb90-983023580724 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:46.561348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74bac2-8260-4897-bb90-983023580724 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:46.561625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74bac2-8260-4897-bb90-983023580724 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:46.562317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74bac2-8260-4897-bb90-983023580724 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:46.562624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74bac2-8260-4897-bb90-983023580724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:46.564060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74bac2-8260-4897-bb90-983023580724 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:46.574454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 127/244] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:46.581325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fadc5-f8ce-4bee-bd3e-cbe5fb655e3c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:46.694103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74bac2-8260-4897-bb90-983023580724 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:46.699300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fadc5-f8ce-4bee-bd3e-cbe5fb655e3c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:46.738620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8557294-7598-49d3-a5cf-155b584a1ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:46.739584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8557294-7598-49d3-a5cf-155b584a1ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:46.740066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8557294-7598-49d3-a5cf-155b584a1ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:46.740515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8557294-7598-49d3-a5cf-155b584a1ce9 None admin] PATH_INFO: `/v3/users/af498a5430bc43228f7ff3934e16f711` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:46.756485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8557294-7598-49d3-a5cf-155b584a1ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=af498a5430bc43228f7ff3934e16f711)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:46.759090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8557294-7598-49d3-a5cf-155b584a1ce9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:46.760973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 118/245] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:46 2022] GET /identity/v3/users/af498a5430bc43228f7ff3934e16f711 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:46.766484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8557294-7598-49d3-a5cf-155b584a1ce9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:46.801412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:46.816095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74bac2-8260-4897-bb90-983023580724 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:46.864169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d018653-96b0-44ae-acd4-26835bb13401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:46.865646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d018653-96b0-44ae-acd4-26835bb13401 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:46.867085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d018653-96b0-44ae-acd4-26835bb13401 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:46.867542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d018653-96b0-44ae-acd4-26835bb13401 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:46.882662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d018653-96b0-44ae-acd4-26835bb13401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-5d018653-96b0-44ae-acd4-26835bb13401 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:46.888449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:46.889560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:46.890518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:46.893249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 128/246] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:46.899432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d018653-96b0-44ae-acd4-26835bb13401 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:46.905075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8557294-7598-49d3-a5cf-155b584a1ce9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:46.946974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08b1ed-e75d-49c6-b142-d501b96a3404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:46.947585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b1ed-e75d-49c6-b142-d501b96a3404 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:46.947861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b1ed-e75d-49c6-b142-d501b96a3404 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:46.948127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b1ed-e75d-49c6-b142-d501b96a3404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:46.962935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:47.024067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08b1ed-e75d-49c6-b142-d501b96a3404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:47.025366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d018653-96b0-44ae-acd4-26835bb13401 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:47.025496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08b1ed-e75d-49c6-b142-d501b96a3404 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:47.053450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:47.072122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeeaa6-59c0-42aa-9631-97aca92ee269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:47.072788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeeaa6-59c0-42aa-9631-97aca92ee269 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:47.073065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeeaa6-59c0-42aa-9631-97aca92ee269 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:47.073706 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeeaa6-59c0-42aa-9631-97aca92ee269 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:47.074425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeeaa6-59c0-42aa-9631-97aca92ee269 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:47.075074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeeaa6-59c0-42aa-9631-97aca92ee269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:47.076765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeeaa6-59c0-42aa-9631-97aca92ee269 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:47.086943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 129/247] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:47.088484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbc046-1e43-4075-9ddc-d6eadb820df4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:47.089051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbc046-1e43-4075-9ddc-d6eadb820df4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:47.089514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbc046-1e43-4075-9ddc-d6eadb820df4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:47.091104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 130/248] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:47.095553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbc046-1e43-4075-9ddc-d6eadb820df4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:47.160549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 119/249] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:20:47.162725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240488-97cc-46c8-a8a2-96ca75816eda None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:47.163269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240488-97cc-46c8-a8a2-96ca75816eda None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:47.164798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240488-97cc-46c8-a8a2-96ca75816eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:47.191189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3a240488-97cc-46c8-a8a2-96ca75816eda None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:47.192816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3a240488-97cc-46c8-a8a2-96ca75816eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:47.223807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbc046-1e43-4075-9ddc-d6eadb820df4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:47.239118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:47.270062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b861395-f0b3-4291-9bd8-c5f3175cafe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:47.272612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861395-f0b3-4291-9bd8-c5f3175cafe9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:47.272612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861395-f0b3-4291-9bd8-c5f3175cafe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:47.272612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861395-f0b3-4291-9bd8-c5f3175cafe9 None admin] PATH_INFO: `/v3/users/13a122235e9f42af98fd3ad7ad11bf8a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:47.275228 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861395-f0b3-4291-9bd8-c5f3175cafe9 None admin] RBAC: Authorizing `identity:get_user(user_id=13a122235e9f42af98fd3ad7ad11bf8a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:47.276654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861395-f0b3-4291-9bd8-c5f3175cafe9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:47.278692 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 131/250] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:47 2022] GET /identity/v3/users/13a122235e9f42af98fd3ad7ad11bf8a => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:47.279736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b861395-f0b3-4291-9bd8-c5f3175cafe9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:47.313684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 120/251] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:47.314647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a240488-97cc-46c8-a8a2-96ca75816eda None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:47.400591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:47.476850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b861395-f0b3-4291-9bd8-c5f3175cafe9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:47.480735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a240488-97cc-46c8-a8a2-96ca75816eda None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:47.538661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b68b3-d772-4910-aa7d-d9fb75692efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:47.540582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b68b3-d772-4910-aa7d-d9fb75692efe None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:47.541066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b68b3-d772-4910-aa7d-d9fb75692efe None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:47.541553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b68b3-d772-4910-aa7d-d9fb75692efe None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:47.542974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b68b3-d772-4910-aa7d-d9fb75692efe None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:47.550751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b68b3-d772-4910-aa7d-d9fb75692efe None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:47.552768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 132/252] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:47 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:47.559243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b68b3-d772-4910-aa7d-d9fb75692efe None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:47.571434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a35942-107b-4288-9bc7-a4fadee6cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:47.572093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a35942-107b-4288-9bc7-a4fadee6cdea None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:47.572384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a35942-107b-4288-9bc7-a4fadee6cdea None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:47.572663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a35942-107b-4288-9bc7-a4fadee6cdea None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:47.573854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a35942-107b-4288-9bc7-a4fadee6cdea None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:47.577394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a35942-107b-4288-9bc7-a4fadee6cdea None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:47.577394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 121/253] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:47 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:47.583447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a35942-107b-4288-9bc7-a4fadee6cdea None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:47.646326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:47.718131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b68b3-d772-4910-aa7d-d9fb75692efe None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:47.784070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61cf2-7ede-4d8b-9e6a-029f7d05e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:47.786654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61cf2-7ede-4d8b-9e6a-029f7d05e2fa None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:47.790029 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a35942-107b-4288-9bc7-a4fadee6cdea None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:47.790735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61cf2-7ede-4d8b-9e6a-029f7d05e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:47.791222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61cf2-7ede-4d8b-9e6a-029f7d05e2fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:47.792231 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61cf2-7ede-4d8b-9e6a-029f7d05e2fa None admin] RBAC: Adding query filter params (role.id=af54b7a166d9431c8f6a2fde986f4cda, scope.project.id=fdf4e0e74ba94622a91171159045ae6d, user.id=af498a5430bc43228f7ff3934e16f711) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:47.792779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61cf2-7ede-4d8b-9e6a-029f7d05e2fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:47.794507 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61cf2-7ede-4d8b-9e6a-029f7d05e2fa None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:47.801501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 133/254] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:47 2022] GET /identity/v3/role_assignments?user.id=af498a5430bc43228f7ff3934e16f711&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=af54b7a166d9431c8f6a2fde986f4cda => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:47.802786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61cf2-7ede-4d8b-9e6a-029f7d05e2fa None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:47.830944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:47.871108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2f102-7823-4e78-936b-8d7c3e56fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:47.871794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f102-7823-4e78-936b-8d7c3e56fa13 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:47.872069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f102-7823-4e78-936b-8d7c3e56fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:47.872337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f102-7823-4e78-936b-8d7c3e56fa13 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d/users/13a122235e9f42af98fd3ad7ad11bf8a/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:47.876238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2f102-7823-4e78-936b-8d7c3e56fa13 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdf4e0e74ba94622a91171159045ae6d, user_id=13a122235e9f42af98fd3ad7ad11bf8a, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:47.877770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2f102-7823-4e78-936b-8d7c3e56fa13 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:47.912451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 122/255] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:20:47 2022] PUT /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d/users/13a122235e9f42af98fd3ad7ad11bf8a/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:20:47.947163 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc619f4-108a-4cdc-b211-9603733107d1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:47.947487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc619f4-108a-4cdc-b211-9603733107d1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:47.947714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc619f4-108a-4cdc-b211-9603733107d1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:47.949145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 123/256] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:47.955212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271fc4d-231a-4777-9c29-22e3bcb8b84b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:47.955490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271fc4d-231a-4777-9c29-22e3bcb8b84b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:47.955761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271fc4d-231a-4777-9c29-22e3bcb8b84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:47.987519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a271fc4d-231a-4777-9c29-22e3bcb8b84b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:47.989319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a271fc4d-231a-4777-9c29-22e3bcb8b84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:47.997000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61cf2-7ede-4d8b-9e6a-029f7d05e2fa None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:48.005084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:48.032923 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc220e9-3218-42a6-a2b6-f7ece1777587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:48.033624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc220e9-3218-42a6-a2b6-f7ece1777587 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:48.033902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc220e9-3218-42a6-a2b6-f7ece1777587 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:48.034226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc220e9-3218-42a6-a2b6-f7ece1777587 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:48.055391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc220e9-3218-42a6-a2b6-f7ece1777587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-fdc220e9-3218-42a6-a2b6-f7ece1777587 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:48.060937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:48.061896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:48.062724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 134/257] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:20:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:48.068106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc220e9-3218-42a6-a2b6-f7ece1777587 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:48.096596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 124/258] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:48.182156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc220e9-3218-42a6-a2b6-f7ece1777587 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:48.218331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0bf95-20de-42bb-8828-b2fd8299f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:48.218972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0bf95-20de-42bb-8828-b2fd8299f13c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:48.219248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0bf95-20de-42bb-8828-b2fd8299f13c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:48.219523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0bf95-20de-42bb-8828-b2fd8299f13c None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:48.220181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0bf95-20de-42bb-8828-b2fd8299f13c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:48.220481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0bf95-20de-42bb-8828-b2fd8299f13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:48.221964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0bf95-20de-42bb-8828-b2fd8299f13c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:48.231425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 135/259] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:48.237171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271fc4d-231a-4777-9c29-22e3bcb8b84b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:48.348157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271fc4d-231a-4777-9c29-22e3bcb8b84b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:48.361282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:48.393260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb659451-7438-456a-be9e-920a08eeef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:48.393893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb659451-7438-456a-be9e-920a08eeef6a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:48.394167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb659451-7438-456a-be9e-920a08eeef6a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:48.394435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb659451-7438-456a-be9e-920a08eeef6a None admin] PATH_INFO: `/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:48.397067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb659451-7438-456a-be9e-920a08eeef6a None admin] RBAC: Authorizing `identity:get_user(user_id=0fcd1fe79dfb4e4cbd57c8864e9a7746)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:48.398659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb659451-7438-456a-be9e-920a08eeef6a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:48.400336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 125/260] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:48 2022] GET /identity/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:48.405802 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0bf95-20de-42bb-8828-b2fd8299f13c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:48.439899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb659451-7438-456a-be9e-920a08eeef6a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:48.442816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:48.578615 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0bf95-20de-42bb-8828-b2fd8299f13c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:48.609623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb659451-7438-456a-be9e-920a08eeef6a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:48.660679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f518879-e420-498f-9419-2d75c588232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:48.661300 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518879-e420-498f-9419-2d75c588232d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:48.661580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518879-e420-498f-9419-2d75c588232d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:48.661852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518879-e420-498f-9419-2d75c588232d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:48.704947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0423c-ec65-4b54-abd1-d1b2a1091d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:48.704947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0423c-ec65-4b54-abd1-d1b2a1091d2a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:48.704947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0423c-ec65-4b54-abd1-d1b2a1091d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:48.704947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0423c-ec65-4b54-abd1-d1b2a1091d2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:48.731512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0423c-ec65-4b54-abd1-d1b2a1091d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-65d0423c-ec65-4b54-abd1-d1b2a1091d2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:48.734498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:48.735383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:20:48.736836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:48.743176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 126/261] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:20:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:48.744573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0423c-ec65-4b54-abd1-d1b2a1091d2a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:48.802189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f518879-e420-498f-9419-2d75c588232d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:48.808340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f518879-e420-498f-9419-2d75c588232d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:48.857286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:48.873622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:48.961248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0423c-ec65-4b54-abd1-d1b2a1091d2a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:48.993440 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 136/262] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:48.998889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f518879-e420-498f-9419-2d75c588232d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:49.008893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b894-9c09-42b9-9e2e-06d714620049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:49.009516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b894-9c09-42b9-9e2e-06d714620049 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:49.009805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b894-9c09-42b9-9e2e-06d714620049 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:49.010080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b894-9c09-42b9-9e2e-06d714620049 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:49.010777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180b894-9c09-42b9-9e2e-06d714620049 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:49.011085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180b894-9c09-42b9-9e2e-06d714620049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:49.014697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180b894-9c09-42b9-9e2e-06d714620049 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:49.025549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 127/263] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:20:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:49.031642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b894-9c09-42b9-9e2e-06d714620049 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:49.231686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f518879-e420-498f-9419-2d75c588232d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:49.257067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:49.263252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b894-9c09-42b9-9e2e-06d714620049 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:49.311677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:49.320794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd9a6e-b653-4031-92fc-002c65ed76d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:49.321883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd9a6e-b653-4031-92fc-002c65ed76d7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:49.327038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd9a6e-b653-4031-92fc-002c65ed76d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:49.327323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd9a6e-b653-4031-92fc-002c65ed76d7 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:49.328504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd9a6e-b653-4031-92fc-002c65ed76d7 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:49.329968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd9a6e-b653-4031-92fc-002c65ed76d7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:49.331818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 137/264] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:48 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:49.338011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd9a6e-b653-4031-92fc-002c65ed76d7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:49.339210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5b5f0-63a4-49ec-87c4-144fe41d2fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:49.340062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5b5f0-63a4-49ec-87c4-144fe41d2fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:49.340541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5b5f0-63a4-49ec-87c4-144fe41d2fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:49.341006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5b5f0-63a4-49ec-87c4-144fe41d2fa5 None admin] PATH_INFO: `/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:49.342335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5b5f0-63a4-49ec-87c4-144fe41d2fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=0fcd1fe79dfb4e4cbd57c8864e9a7746)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:49.344017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5b5f0-63a4-49ec-87c4-144fe41d2fa5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:49.352164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 128/265] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:49 2022] GET /identity/v3/users/0fcd1fe79dfb4e4cbd57c8864e9a7746 => generated 283 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:49.363900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5b5f0-63a4-49ec-87c4-144fe41d2fa5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:49.541151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5b5f0-63a4-49ec-87c4-144fe41d2fa5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:49.585505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd9a6e-b653-4031-92fc-002c65ed76d7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:49.618361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4c1d2-39a1-4b90-95e8-46b1487df4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:49.619016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c1d2-39a1-4b90-95e8-46b1487df4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:49.619286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c1d2-39a1-4b90-95e8-46b1487df4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:49.619554 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c1d2-39a1-4b90-95e8-46b1487df4f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:49.644267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea44c89-8f7e-434a-9f21-da453c015050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:49.645216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea44c89-8f7e-434a-9f21-da453c015050 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:49.645686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea44c89-8f7e-434a-9f21-da453c015050 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:49.646143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea44c89-8f7e-434a-9f21-da453c015050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:49.647086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea44c89-8f7e-434a-9f21-da453c015050 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=fdf4e0e74ba94622a91171159045ae6d, user.id=0fcd1fe79dfb4e4cbd57c8864e9a7746) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:49.648157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea44c89-8f7e-434a-9f21-da453c015050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:49.649895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea44c89-8f7e-434a-9f21-da453c015050 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:49.668392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 138/266] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:49 2022] GET /identity/v3/role_assignments?user.id=0fcd1fe79dfb4e4cbd57c8864e9a7746&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:49.686356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:49.735056 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4c1d2-39a1-4b90-95e8-46b1487df4f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:49.736561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4c1d2-39a1-4b90-95e8-46b1487df4f6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:49.846992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 129/267] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:20:49.852516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea44c89-8f7e-434a-9f21-da453c015050 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:49.955195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:49.999503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea44c89-8f7e-434a-9f21-da453c015050 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:50.038249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a8812-ad92-4fb8-8b4d-c1f4b6f6bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:50.038896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8812-ad92-4fb8-8b4d-c1f4b6f6bbee None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.039172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8812-ad92-4fb8-8b4d-c1f4b6f6bbee None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.039441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8812-ad92-4fb8-8b4d-c1f4b6f6bbee None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.040583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a8812-ad92-4fb8-8b4d-c1f4b6f6bbee None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:50.042016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a8812-ad92-4fb8-8b4d-c1f4b6f6bbee None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:50.043975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 139/268] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:49 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:50.049650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4c1d2-39a1-4b90-95e8-46b1487df4f6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:50.094250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e47b-19c8-4253-8689-ce35c5b18bd5 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.094552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e47b-19c8-4253-8689-ce35c5b18bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.094850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e47b-19c8-4253-8689-ce35c5b18bd5 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.096255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 140/269] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:50.101923 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519bfdc-984a-4fae-943c-b2fd7ae4a81e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.102133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519bfdc-984a-4fae-943c-b2fd7ae4a81e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.102410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519bfdc-984a-4fae-943c-b2fd7ae4a81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.120743 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1519bfdc-984a-4fae-943c-b2fd7ae4a81e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:50.122160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1519bfdc-984a-4fae-943c-b2fd7ae4a81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:50.155569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:50.221782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 141/270] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:50.228664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4c1d2-39a1-4b90-95e8-46b1487df4f6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:50.275385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a85c8a-094c-4312-80a8-880d72b94322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:50.276001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85c8a-094c-4312-80a8-880d72b94322 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.276275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85c8a-094c-4312-80a8-880d72b94322 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.276541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85c8a-094c-4312-80a8-880d72b94322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.277274 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a85c8a-094c-4312-80a8-880d72b94322 None admin] RBAC: Adding query filter params (role.id=8bc105194aae4f11b5a2b917bb621f1f, scope.project.id=fdf4e0e74ba94622a91171159045ae6d, user.id=0fcd1fe79dfb4e4cbd57c8864e9a7746) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:50.277582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a85c8a-094c-4312-80a8-880d72b94322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:50.279059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a85c8a-094c-4312-80a8-880d72b94322 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:50.285526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 130/271] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:50 2022] GET /identity/v3/role_assignments?user.id=0fcd1fe79dfb4e4cbd57c8864e9a7746&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=8bc105194aae4f11b5a2b917bb621f1f => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:50.593848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519bfdc-984a-4fae-943c-b2fd7ae4a81e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:50.661929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:50.701875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519bfdc-984a-4fae-943c-b2fd7ae4a81e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:50.728732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19ecf-9324-4ee2-938a-b20c8f9ca756 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.729230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19ecf-9324-4ee2-938a-b20c8f9ca756 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.729305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19ecf-9324-4ee2-938a-b20c8f9ca756 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.730712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 131/272] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:50.738034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944dbd-a0da-4736-9130-03b7958232d2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.738458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944dbd-a0da-4736-9130-03b7958232d2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.738871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944dbd-a0da-4736-9130-03b7958232d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.745766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e44a6-bc4e-46ea-a1d6-7e0812a6d092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:50.746886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e44a6-bc4e-46ea-a1d6-7e0812a6d092 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.747303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e44a6-bc4e-46ea-a1d6-7e0812a6d092 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.747831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e44a6-bc4e-46ea-a1d6-7e0812a6d092 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.763360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e44a6-bc4e-46ea-a1d6-7e0812a6d092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:50.767158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4f944dbd-a0da-4736-9130-03b7958232d2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-884e44a6-bc4e-46ea-a1d6-7e0812a6d092 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:50.768676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:50.769569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:50.770360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:50.771030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 142/273] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:50.771753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f944dbd-a0da-4736-9130-03b7958232d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:50.778752 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e44a6-bc4e-46ea-a1d6-7e0812a6d092 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:50.878717 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 132/274] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:50.888169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401c86f-1177-406a-aa32-a9751ac49a8f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.888446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401c86f-1177-406a-aa32-a9751ac49a8f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.888721 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401c86f-1177-406a-aa32-a9751ac49a8f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.890321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 133/275] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:50.896604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420802fa-3485-407b-8b71-2318ae1f6b75 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.896604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420802fa-3485-407b-8b71-2318ae1f6b75 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.896843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420802fa-3485-407b-8b71-2318ae1f6b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.908748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e44a6-bc4e-46ea-a1d6-7e0812a6d092 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:50.917432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-420802fa-3485-407b-8b71-2318ae1f6b75 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:50.918635 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-420802fa-3485-407b-8b71-2318ae1f6b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:50.932334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:50.945972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fd98a-758a-48e4-86c4-954ce95009b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:50.946588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd98a-758a-48e4-86c4-954ce95009b3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.946884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd98a-758a-48e4-86c4-954ce95009b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.947159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd98a-758a-48e4-86c4-954ce95009b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.947823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fd98a-758a-48e4-86c4-954ce95009b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:50.948129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fd98a-758a-48e4-86c4-954ce95009b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:50.949514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fd98a-758a-48e4-86c4-954ce95009b3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:50.957731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 143/276] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:50.957731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a8e47-c774-4a43-a1a2-4816ca191f5e None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:50.957731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a8e47-c774-4a43-a1a2-4816ca191f5e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:50.957731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a8e47-c774-4a43-a1a2-4816ca191f5e None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:50.957731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 144/277] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:50.966254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a8e47-c774-4a43-a1a2-4816ca191f5e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:50.982960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:50.994341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 134/278] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:51.003017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487e5e8-9e2b-48f8-b69e-744f17c2a558 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:51.003017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487e5e8-9e2b-48f8-b69e-744f17c2a558 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:51.003017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487e5e8-9e2b-48f8-b69e-744f17c2a558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:51.021083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6487e5e8-9e2b-48f8-b69e-744f17c2a558 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:51.022881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6487e5e8-9e2b-48f8-b69e-744f17c2a558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:51.084385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a8e47-c774-4a43-a1a2-4816ca191f5e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:51.097847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 135/279] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:51.127183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a018af-61b9-4258-8364-8b32b93d9d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:51.127807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a018af-61b9-4258-8364-8b32b93d9d6d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:51.128086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a018af-61b9-4258-8364-8b32b93d9d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:51.128413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a018af-61b9-4258-8364-8b32b93d9d6d None admin] PATH_INFO: `/v3/users/f58a8c1fa3464aa58d0ee34a9ea7fdbe` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:51.143548 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a018af-61b9-4258-8364-8b32b93d9d6d None admin] RBAC: Authorizing `identity:get_user(user_id=f58a8c1fa3464aa58d0ee34a9ea7fdbe)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:51.145079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a018af-61b9-4258-8364-8b32b93d9d6d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:51.147098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 145/280] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:50 2022] GET /identity/v3/users/f58a8c1fa3464aa58d0ee34a9ea7fdbe => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:51.152565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487e5e8-9e2b-48f8-b69e-744f17c2a558 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:51.158207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a018af-61b9-4258-8364-8b32b93d9d6d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:51.203795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:51.273081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a018af-61b9-4258-8364-8b32b93d9d6d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:51.281293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487e5e8-9e2b-48f8-b69e-744f17c2a558 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:51.305614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:51.314827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cca26-6869-4fc7-84d1-a178ba73de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:51.315492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cca26-6869-4fc7-84d1-a178ba73de01 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:51.315736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cca26-6869-4fc7-84d1-a178ba73de01 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:51.316004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cca26-6869-4fc7-84d1-a178ba73de01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:51.317096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cca26-6869-4fc7-84d1-a178ba73de01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:51.318347 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27352f-52d7-427e-95aa-39ad27aef360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:51.318525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cca26-6869-4fc7-84d1-a178ba73de01 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:51.319544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27352f-52d7-427e-95aa-39ad27aef360 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:51.319871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27352f-52d7-427e-95aa-39ad27aef360 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:51.320160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27352f-52d7-427e-95aa-39ad27aef360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:51.320795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 146/281] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:51.320893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27352f-52d7-427e-95aa-39ad27aef360 None admin] RBAC: Adding query filter params (role.id=adb2774e1d254454a97fab85c6000155, user.id=f58a8c1fa3464aa58d0ee34a9ea7fdbe, scope.system=all) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:51.321178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27352f-52d7-427e-95aa-39ad27aef360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:51.322608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27352f-52d7-427e-95aa-39ad27aef360 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:51.325732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cca26-6869-4fc7-84d1-a178ba73de01 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:51.330836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 136/282] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Oct 4 08:20:51 2022] GET /identity/v3/role_assignments?user.id=f58a8c1fa3464aa58d0ee34a9ea7fdbe&scope.system=all&role.id=adb2774e1d254454a97fab85c6000155 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:51.331692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27352f-52d7-427e-95aa-39ad27aef360 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:51.451227 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cca26-6869-4fc7-84d1-a178ba73de01 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:51.451990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27352f-52d7-427e-95aa-39ad27aef360 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:51.467814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:51.493316 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bc4ca-2d33-4ad1-9abd-f54ba34e1bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:51.493974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc4ca-2d33-4ad1-9abd-f54ba34e1bdc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:51.494256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc4ca-2d33-4ad1-9abd-f54ba34e1bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:51.494532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc4ca-2d33-4ad1-9abd-f54ba34e1bdc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:51.499259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a6e7a-39f6-43a6-9f26-414b869a1c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:51.500051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6e7a-39f6-43a6-9f26-414b869a1c2f None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:51.500332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6e7a-39f6-43a6-9f26-414b869a1c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:51.500626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6e7a-39f6-43a6-9f26-414b869a1c2f None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:51.501259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a6e7a-39f6-43a6-9f26-414b869a1c2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:51.503007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a6e7a-39f6-43a6-9f26-414b869a1c2f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:51.506033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bc4ca-2d33-4ad1-9abd-f54ba34e1bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-416bc4ca-2d33-4ad1-9abd-f54ba34e1bdc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:51.511960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:51.512853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 147/283] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:51.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bc4ca-2d33-4ad1-9abd-f54ba34e1bdc None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:51.537451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 137/284] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:20:51 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:51.547761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a6e7a-39f6-43a6-9f26-414b869a1c2f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:51.623253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:51.641949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bc4ca-2d33-4ad1-9abd-f54ba34e1bdc None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:51.684296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c62551-7056-4dc9-9901-9e9c3508e294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:51.685117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c62551-7056-4dc9-9901-9e9c3508e294 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:51.685497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c62551-7056-4dc9-9901-9e9c3508e294 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:51.685758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c62551-7056-4dc9-9901-9e9c3508e294 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:51.700468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c62551-7056-4dc9-9901-9e9c3508e294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-f3c62551-7056-4dc9-9901-9e9c3508e294 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:51.705842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:51.706831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:20:51.707621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 148/285] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:51.709473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a6e7a-39f6-43a6-9f26-414b869a1c2f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:51.715934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c62551-7056-4dc9-9901-9e9c3508e294 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:51.751595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35981e-f7b1-4aa3-9189-09adbf868847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:51.752229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35981e-f7b1-4aa3-9189-09adbf868847 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:51.753649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35981e-f7b1-4aa3-9189-09adbf868847 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:51.753649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35981e-f7b1-4aa3-9189-09adbf868847 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:51.753649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35981e-f7b1-4aa3-9189-09adbf868847 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:51.753890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35981e-f7b1-4aa3-9189-09adbf868847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:51.755525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35981e-f7b1-4aa3-9189-09adbf868847 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:51.761719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:51.766103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 138/286] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:51.771620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35981e-f7b1-4aa3-9189-09adbf868847 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:51.869378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c62551-7056-4dc9-9901-9e9c3508e294 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:51.893650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35981e-f7b1-4aa3-9189-09adbf868847 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:51.898008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:51.919503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c9bd4-d370-4241-a3c2-b9a8515e6207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:51.920588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9bd4-d370-4241-a3c2-b9a8515e6207 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:51.920872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9bd4-d370-4241-a3c2-b9a8515e6207 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:51.921149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9bd4-d370-4241-a3c2-b9a8515e6207 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:51.921821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c9bd4-d370-4241-a3c2-b9a8515e6207 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:51.922130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c9bd4-d370-4241-a3c2-b9a8515e6207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:51.923746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c9bd4-d370-4241-a3c2-b9a8515e6207 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:51.933878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 149/287] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:51.941795 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca415e-ce1d-4a54-bd01-82d7fdde4103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:51.942273 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c9bd4-d370-4241-a3c2-b9a8515e6207 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:51.942874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca415e-ce1d-4a54-bd01-82d7fdde4103 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:51.943354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca415e-ce1d-4a54-bd01-82d7fdde4103 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:51.943801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca415e-ce1d-4a54-bd01-82d7fdde4103 None admin] PATH_INFO: `/v3/users/af498a5430bc43228f7ff3934e16f711` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:51.946603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca415e-ce1d-4a54-bd01-82d7fdde4103 None admin] RBAC: Authorizing `identity:get_user(user_id=af498a5430bc43228f7ff3934e16f711)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:51.948307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca415e-ce1d-4a54-bd01-82d7fdde4103 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:51.950349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 139/288] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:51 2022] GET /identity/v3/users/af498a5430bc43228f7ff3934e16f711 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:51.955628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca415e-ce1d-4a54-bd01-82d7fdde4103 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:52.055107 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:52.060287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c9bd4-d370-4241-a3c2-b9a8515e6207 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:52.071420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca415e-ce1d-4a54-bd01-82d7fdde4103 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:52.105124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed9b91-58f0-4586-b517-f49c37ec8c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:52.105758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9b91-58f0-4586-b517-f49c37ec8c0a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:52.106033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9b91-58f0-4586-b517-f49c37ec8c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:52.106302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9b91-58f0-4586-b517-f49c37ec8c0a None admin] PATH_INFO: `/v3/users/13a122235e9f42af98fd3ad7ad11bf8a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:52.107468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed9b91-58f0-4586-b517-f49c37ec8c0a None admin] RBAC: Authorizing `identity:get_user(user_id=13a122235e9f42af98fd3ad7ad11bf8a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:52.108988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed9b91-58f0-4586-b517-f49c37ec8c0a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:52.110166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a74670-ea6f-41e6-a099-3a5a20699ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:52.110961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 150/289] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:51 2022] GET /identity/v3/users/13a122235e9f42af98fd3ad7ad11bf8a => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:52.111292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a74670-ea6f-41e6-a099-3a5a20699ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:52.111635 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a74670-ea6f-41e6-a099-3a5a20699ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:52.111916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a74670-ea6f-41e6-a099-3a5a20699ee8 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:52.113064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a74670-ea6f-41e6-a099-3a5a20699ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:52.114595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a74670-ea6f-41e6-a099-3a5a20699ee8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:52.117153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed9b91-58f0-4586-b517-f49c37ec8c0a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:52.117441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 140/290] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:51 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:52.124619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a74670-ea6f-41e6-a099-3a5a20699ee8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:52.174177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:52.250377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a74670-ea6f-41e6-a099-3a5a20699ee8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:52.288958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602338-e96c-498f-b885-12c96c6904d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:52.289636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602338-e96c-498f-b885-12c96c6904d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:52.289917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602338-e96c-498f-b885-12c96c6904d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:52.290193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602338-e96c-498f-b885-12c96c6904d7 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d/users/af498a5430bc43228f7ff3934e16f711/roles/af54b7a166d9431c8f6a2fde986f4cda` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:52.292252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602338-e96c-498f-b885-12c96c6904d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdf4e0e74ba94622a91171159045ae6d, user_id=af498a5430bc43228f7ff3934e16f711, role_id=af54b7a166d9431c8f6a2fde986f4cda)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:52.293867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602338-e96c-498f-b885-12c96c6904d7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:52.319528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 141/291] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:20:52 2022] PUT /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d/users/af498a5430bc43228f7ff3934e16f711/roles/af54b7a166d9431c8f6a2fde986f4cda => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:20:52.344530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed9b91-58f0-4586-b517-f49c37ec8c0a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:52.384169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab9ab-7bf5-4aab-8022-f6c1d069a5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:52.384713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab9ab-7bf5-4aab-8022-f6c1d069a5ee None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:52.384991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab9ab-7bf5-4aab-8022-f6c1d069a5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:52.385264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab9ab-7bf5-4aab-8022-f6c1d069a5ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:52.432200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:52.463687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadab9ab-7bf5-4aab-8022-f6c1d069a5ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:52.465621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadab9ab-7bf5-4aab-8022-f6c1d069a5ee None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:52.574942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 151/292] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:20:52.580517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602338-e96c-498f-b885-12c96c6904d7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:52.717436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:52.726300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602338-e96c-498f-b885-12c96c6904d7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:52.769152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f035cd8-a159-4b52-b5d7-98ed8084176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:52.769765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f035cd8-a159-4b52-b5d7-98ed8084176a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:52.770051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f035cd8-a159-4b52-b5d7-98ed8084176a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:52.770317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f035cd8-a159-4b52-b5d7-98ed8084176a None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:52.771458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f035cd8-a159-4b52-b5d7-98ed8084176a None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:52.773100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f035cd8-a159-4b52-b5d7-98ed8084176a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:52.775026 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 142/293] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:52 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:52.780927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab9ab-7bf5-4aab-8022-f6c1d069a5ee None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:52.877669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:52.946397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab9ab-7bf5-4aab-8022-f6c1d069a5ee None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:52.999496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aeaff5-4698-43f4-8269-cb523acbbda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:53.000016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeaff5-4698-43f4-8269-cb523acbbda2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:53.000319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeaff5-4698-43f4-8269-cb523acbbda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:53.000588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeaff5-4698-43f4-8269-cb523acbbda2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:53.001328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aeaff5-4698-43f4-8269-cb523acbbda2 None admin] RBAC: Adding query filter params (role.id=adb2774e1d254454a97fab85c6000155, scope.project.id=fdf4e0e74ba94622a91171159045ae6d, user.id=13a122235e9f42af98fd3ad7ad11bf8a) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:53.001635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aeaff5-4698-43f4-8269-cb523acbbda2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:53.003085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aeaff5-4698-43f4-8269-cb523acbbda2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:53.009828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 152/294] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:52 2022] GET /identity/v3/role_assignments?user.id=13a122235e9f42af98fd3ad7ad11bf8a&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=adb2774e1d254454a97fab85c6000155 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:53.923932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da585-f48c-4f23-b944-9e69acb0cbc5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:53.923932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da585-f48c-4f23-b944-9e69acb0cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:53.923932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da585-f48c-4f23-b944-9e69acb0cbc5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:53.923932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 143/295] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:53.931071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa66df-d274-4606-9a59-f4c45ece72d9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:53.931924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa66df-d274-4606-9a59-f4c45ece72d9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:53.932410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa66df-d274-4606-9a59-f4c45ece72d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:53.951292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a5fa66df-d274-4606-9a59-f4c45ece72d9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:53.952855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a5fa66df-d274-4606-9a59-f4c45ece72d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:54.035017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 153/296] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:54.233506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d39cb-eadb-49e3-b327-b66e364a557c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:54.234248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d39cb-eadb-49e3-b327-b66e364a557c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:54.234774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d39cb-eadb-49e3-b327-b66e364a557c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:54.236728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 144/297] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:54.243492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136baf-1227-445a-9d40-09bf216539dd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:54.244118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136baf-1227-445a-9d40-09bf216539dd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:54.244624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136baf-1227-445a-9d40-09bf216539dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:54.263942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-16136baf-1227-445a-9d40-09bf216539dd None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:54.265471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-16136baf-1227-445a-9d40-09bf216539dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:54.317049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:54.325976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d39cb-eadb-49e3-b327-b66e364a557c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:54.342755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 154/298] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:54.348749 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d082e-53b7-479e-a7dc-4791b8e2de49 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:54.349034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d082e-53b7-479e-a7dc-4791b8e2de49 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:54.349473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d082e-53b7-479e-a7dc-4791b8e2de49 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:54.351667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 155/299] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:54.356595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4237a26-f010-4c89-b571-4578c3c3ca45 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:54.356875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4237a26-f010-4c89-b571-4578c3c3ca45 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:54.357149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4237a26-f010-4c89-b571-4578c3c3ca45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:54.377528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c4237a26-f010-4c89-b571-4578c3c3ca45 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:54.378857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c4237a26-f010-4c89-b571-4578c3c3ca45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:54.450969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d39cb-eadb-49e3-b327-b66e364a557c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:54.471429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 156/300] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:20:54.497421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f225eec-9434-426f-b398-53d54cc47bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:54.498400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f225eec-9434-426f-b398-53d54cc47bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:54.498932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f225eec-9434-426f-b398-53d54cc47bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:54.499456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f225eec-9434-426f-b398-53d54cc47bd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:54.511794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f225eec-9434-426f-b398-53d54cc47bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6f225eec-9434-426f-b398-53d54cc47bd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:54.517498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:54.518384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:54.519232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:54.521765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 145/301] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:54.529031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4237a26-f010-4c89-b571-4578c3c3ca45 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:54.633017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4237a26-f010-4c89-b571-4578c3c3ca45 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:54.633592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f225eec-9434-426f-b398-53d54cc47bd9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:54.649015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:54.670576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:54.675177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc55957-104e-46ec-86d8-94c56763d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:54.676158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc55957-104e-46ec-86d8-94c56763d860 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:54.676417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc55957-104e-46ec-86d8-94c56763d860 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:54.676692 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc55957-104e-46ec-86d8-94c56763d860 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:54.677357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc55957-104e-46ec-86d8-94c56763d860 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:54.677660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc55957-104e-46ec-86d8-94c56763d860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:54.679994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc55957-104e-46ec-86d8-94c56763d860 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:54.691109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 157/302] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:54.697340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc55957-104e-46ec-86d8-94c56763d860 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:54.765177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f225eec-9434-426f-b398-53d54cc47bd9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:54.801167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c583d4-0e0c-455c-b847-99ed2d0d1e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:54.801795 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c583d4-0e0c-455c-b847-99ed2d0d1e73 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:54.802074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c583d4-0e0c-455c-b847-99ed2d0d1e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:54.802343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c583d4-0e0c-455c-b847-99ed2d0d1e73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:54.803498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c583d4-0e0c-455c-b847-99ed2d0d1e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:54.804965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c583d4-0e0c-455c-b847-99ed2d0d1e73 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:54.806529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 146/303] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:54.806529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c583d4-0e0c-455c-b847-99ed2d0d1e73 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:54.839482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc55957-104e-46ec-86d8-94c56763d860 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:54.878580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84ae13-d499-4af2-b931-72ced62b04f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:54.879547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84ae13-d499-4af2-b931-72ced62b04f2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:54.879974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84ae13-d499-4af2-b931-72ced62b04f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:54.880254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84ae13-d499-4af2-b931-72ced62b04f2 None admin] PATH_INFO: `/v3/users/f58a8c1fa3464aa58d0ee34a9ea7fdbe` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:54.881411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84ae13-d499-4af2-b931-72ced62b04f2 None admin] RBAC: Authorizing `identity:get_user(user_id=f58a8c1fa3464aa58d0ee34a9ea7fdbe)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:54.882930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84ae13-d499-4af2-b931-72ced62b04f2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:54.884513 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 158/304] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:54 2022] GET /identity/v3/users/f58a8c1fa3464aa58d0ee34a9ea7fdbe => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:54.884513 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84ae13-d499-4af2-b931-72ced62b04f2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:54.918987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:54.926662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c583d4-0e0c-455c-b847-99ed2d0d1e73 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:54.938454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:54.964999 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8361-3eca-4639-8721-3180db425f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:54.965622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8361-3eca-4639-8721-3180db425f4b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:54.965901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8361-3eca-4639-8721-3180db425f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:54.966175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8361-3eca-4639-8721-3180db425f4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:54.976139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa8361-3eca-4639-8721-3180db425f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7dfa8361-3eca-4639-8721-3180db425f4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:54.981359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:54.982243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:54.983082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 147/305] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:20:54.983733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8361-3eca-4639-8721-3180db425f4b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:54.995821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84ae13-d499-4af2-b931-72ced62b04f2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:55.029315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209224f8-d84f-4cc3-848c-85e3b4bc257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:55.029857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209224f8-d84f-4cc3-848c-85e3b4bc257b None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:55.030137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209224f8-d84f-4cc3-848c-85e3b4bc257b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:55.030412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209224f8-d84f-4cc3-848c-85e3b4bc257b None admin] PATH_INFO: `/v3/groups` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:55.031068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209224f8-d84f-4cc3-848c-85e3b4bc257b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:55.032502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209224f8-d84f-4cc3-848c-85e3b4bc257b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:55.049236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 159/306] 10.222.0.23 () {60 vars in 1134 bytes} [Tue Oct 4 08:20:54 2022] POST /identity/v3/groups => generated 229 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:55.049236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73e56d-af3e-4c88-93dd-87127febcf9c None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:55.049236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73e56d-af3e-4c88-93dd-87127febcf9c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:55.049236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73e56d-af3e-4c88-93dd-87127febcf9c None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:55.049236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 160/307] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:55.049236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73e56d-af3e-4c88-93dd-87127febcf9c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:55.094689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8361-3eca-4639-8721-3180db425f4b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:55.132914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d1084-7629-4cb0-8368-14ee997917d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:55.133616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1084-7629-4cb0-8368-14ee997917d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:55.133899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1084-7629-4cb0-8368-14ee997917d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:55.134174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1084-7629-4cb0-8368-14ee997917d3 None admin] PATH_INFO: `/v3/system/users/f58a8c1fa3464aa58d0ee34a9ea7fdbe/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:55.135797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d1084-7629-4cb0-8368-14ee997917d3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f58a8c1fa3464aa58d0ee34a9ea7fdbe, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:55.137299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d1084-7629-4cb0-8368-14ee997917d3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:55.148712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 148/308] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Oct 4 08:20:54 2022] PUT /identity/v3/system/users/f58a8c1fa3464aa58d0ee34a9ea7fdbe/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:20:55.149974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a594c5-a393-4780-8a2b-9b42cfe0df30 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:55.150259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a594c5-a393-4780-8a2b-9b42cfe0df30 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:55.150533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a594c5-a393-4780-8a2b-9b42cfe0df30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:55.171365 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-96a594c5-a393-4780-8a2b-9b42cfe0df30 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:55.172831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-96a594c5-a393-4780-8a2b-9b42cfe0df30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:55.191388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:55.216095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73e56d-af3e-4c88-93dd-87127febcf9c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:55.239065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:55.268844 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865907a-b1e4-4f21-8ab0-43c57cf97b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:55.269468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865907a-b1e4-4f21-8ab0-43c57cf97b3e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:55.269749 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865907a-b1e4-4f21-8ab0-43c57cf97b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:55.270019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865907a-b1e4-4f21-8ab0-43c57cf97b3e None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:55.271651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865907a-b1e4-4f21-8ab0-43c57cf97b3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:55.271651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865907a-b1e4-4f21-8ab0-43c57cf97b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:55.274949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865907a-b1e4-4f21-8ab0-43c57cf97b3e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:55.275112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 149/309] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:55.286624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 161/310] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:55.293212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a594c5-a393-4780-8a2b-9b42cfe0df30 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:55.403326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a594c5-a393-4780-8a2b-9b42cfe0df30 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:55.440354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1605067-51a4-4002-92fb-982a4cd694c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:55.441284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1605067-51a4-4002-92fb-982a4cd694c5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:55.441742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1605067-51a4-4002-92fb-982a4cd694c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:55.442216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1605067-51a4-4002-92fb-982a4cd694c5 None admin] PATH_INFO: `/v3/users/fc30c3290dab45a192404e1c7ef4563d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:55.462815 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1605067-51a4-4002-92fb-982a4cd694c5 None admin] RBAC: Authorizing `identity:get_user(user_id=fc30c3290dab45a192404e1c7ef4563d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:55.464638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1605067-51a4-4002-92fb-982a4cd694c5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:55.470522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 150/311] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:55 2022] GET /identity/v3/users/fc30c3290dab45a192404e1c7ef4563d => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:55.474287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865907a-b1e4-4f21-8ab0-43c57cf97b3e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:55.560898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1605067-51a4-4002-92fb-982a4cd694c5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:55.577921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865907a-b1e4-4f21-8ab0-43c57cf97b3e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:55.578604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:55.618554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bac337-d2a5-4bbb-a8b0-9d73af7f188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:55.619199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bac337-d2a5-4bbb-a8b0-9d73af7f188f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:55.619470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bac337-d2a5-4bbb-a8b0-9d73af7f188f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:55.619736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bac337-d2a5-4bbb-a8b0-9d73af7f188f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:55.620472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bac337-d2a5-4bbb-a8b0-9d73af7f188f None admin] RBAC: Adding query filter params (role.id=af54b7a166d9431c8f6a2fde986f4cda, user.id=fc30c3290dab45a192404e1c7ef4563d, scope.system=all) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:55.620777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bac337-d2a5-4bbb-a8b0-9d73af7f188f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:55.622213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bac337-d2a5-4bbb-a8b0-9d73af7f188f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:55.628417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 162/312] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Oct 4 08:20:55 2022] GET /identity/v3/role_assignments?user.id=fc30c3290dab45a192404e1c7ef4563d&scope.system=all&role.id=af54b7a166d9431c8f6a2fde986f4cda => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:55.704924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1605067-51a4-4002-92fb-982a4cd694c5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:55.745127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eae4c6-fefb-47a1-b31c-5d6dce15483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:55.745776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eae4c6-fefb-47a1-b31c-5d6dce15483e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:55.746053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eae4c6-fefb-47a1-b31c-5d6dce15483e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:55.746325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eae4c6-fefb-47a1-b31c-5d6dce15483e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:55.759231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eae4c6-fefb-47a1-b31c-5d6dce15483e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-69eae4c6-fefb-47a1-b31c-5d6dce15483e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:55.764297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:55.765224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:55.766009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 151/313] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:55.774156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bac337-d2a5-4bbb-a8b0-9d73af7f188f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:55.814244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:55.895261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bac337-d2a5-4bbb-a8b0-9d73af7f188f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:55.934760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52342-1278-4b99-8e97-5abaeb2e4cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:55.936157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52342-1278-4b99-8e97-5abaeb2e4cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:55.936838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52342-1278-4b99-8e97-5abaeb2e4cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:55.937494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52342-1278-4b99-8e97-5abaeb2e4cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:55.939040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a52342-1278-4b99-8e97-5abaeb2e4cf1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:55.940386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a52342-1278-4b99-8e97-5abaeb2e4cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:55.941959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a52342-1278-4b99-8e97-5abaeb2e4cf1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:55.951345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 163/314] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:55.958730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eae4c6-fefb-47a1-b31c-5d6dce15483e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:56.041393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:56.082163 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eae4c6-fefb-47a1-b31c-5d6dce15483e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:56.120510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fabb68-60fb-4b22-ac74-126d11d652e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:56.121176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fabb68-60fb-4b22-ac74-126d11d652e2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:56.121461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fabb68-60fb-4b22-ac74-126d11d652e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:56.121738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fabb68-60fb-4b22-ac74-126d11d652e2 None admin] PATH_INFO: `/v3/users/af498a5430bc43228f7ff3934e16f711` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:56.122913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fabb68-60fb-4b22-ac74-126d11d652e2 None admin] RBAC: Authorizing `identity:get_user(user_id=af498a5430bc43228f7ff3934e16f711)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:56.124411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fabb68-60fb-4b22-ac74-126d11d652e2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:56.126322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 152/315] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:55 2022] GET /identity/v3/users/af498a5430bc43228f7ff3934e16f711 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:56.132540 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52342-1278-4b99-8e97-5abaeb2e4cf1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:56.232819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:56.242757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52342-1278-4b99-8e97-5abaeb2e4cf1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:56.278752 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ae78c-bb61-4a01-9c32-b22bc41db4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:56.279366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ae78c-bb61-4a01-9c32-b22bc41db4ee None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:56.279650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ae78c-bb61-4a01-9c32-b22bc41db4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:56.279927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ae78c-bb61-4a01-9c32-b22bc41db4ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:56.359975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ae78c-bb61-4a01-9c32-b22bc41db4ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:56.361493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ae78c-bb61-4a01-9c32-b22bc41db4ee None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:56.457149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:56.467594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 164/316] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:20:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:20:56.473275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fabb68-60fb-4b22-ac74-126d11d652e2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:56.583462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fabb68-60fb-4b22-ac74-126d11d652e2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:56.622147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3994-9b69-4e2c-b1ab-07806e422fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:56.622748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3994-9b69-4e2c-b1ab-07806e422fac None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:56.623037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3994-9b69-4e2c-b1ab-07806e422fac None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:56.623324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3994-9b69-4e2c-b1ab-07806e422fac None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:56.624540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3994-9b69-4e2c-b1ab-07806e422fac None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:56.626055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3994-9b69-4e2c-b1ab-07806e422fac None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:56.628152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 153/317] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:20:56 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:56.635186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ae78c-bb61-4a01-9c32-b22bc41db4ee None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:56.746930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ae78c-bb61-4a01-9c32-b22bc41db4ee None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:56.781730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab46d2-0c1b-44bc-8cc2-b07376c073e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:56.782339 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab46d2-0c1b-44bc-8cc2-b07376c073e0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:56.782621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab46d2-0c1b-44bc-8cc2-b07376c073e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:56.782992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab46d2-0c1b-44bc-8cc2-b07376c073e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:56.783725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab46d2-0c1b-44bc-8cc2-b07376c073e0 None admin] RBAC: Adding query filter params (role.id=af54b7a166d9431c8f6a2fde986f4cda, scope.project.id=fdf4e0e74ba94622a91171159045ae6d, user.id=af498a5430bc43228f7ff3934e16f711) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:56.784035 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab46d2-0c1b-44bc-8cc2-b07376c073e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:56.785483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab46d2-0c1b-44bc-8cc2-b07376c073e0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:56.792739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 165/318] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:20:56 2022] GET /identity/v3/role_assignments?user.id=af498a5430bc43228f7ff3934e16f711&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=af54b7a166d9431c8f6a2fde986f4cda => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:57.479723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b270c11-4500-4315-9ef1-7df0c953e341 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:57.480202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b270c11-4500-4315-9ef1-7df0c953e341 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:57.480309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b270c11-4500-4315-9ef1-7df0c953e341 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:57.481757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 154/319] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:57.488052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362028e-447b-4cc1-bcc7-72fedf584904 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:57.488052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362028e-447b-4cc1-bcc7-72fedf584904 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:57.488052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362028e-447b-4cc1-bcc7-72fedf584904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:57.508736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0362028e-447b-4cc1-bcc7-72fedf584904 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:57.509926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0362028e-447b-4cc1-bcc7-72fedf584904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:57.562358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:57.580266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 166/320] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:57.779835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67a80-1cde-4b43-ad40-a8d893c27b33 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:57.780163 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67a80-1cde-4b43-ad40-a8d893c27b33 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:57.780521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67a80-1cde-4b43-ad40-a8d893c27b33 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:57.782555 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 155/321] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:20:57.789547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363c33-4803-4bd8-8705-e89c326809e8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:57.789946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363c33-4803-4bd8-8705-e89c326809e8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:57.790323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363c33-4803-4bd8-8705-e89c326809e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:57.816373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-af363c33-4803-4bd8-8705-e89c326809e8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:57.818037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-af363c33-4803-4bd8-8705-e89c326809e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:57.858076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67a80-1cde-4b43-ad40-a8d893c27b33 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:57.862428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:57.903330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 167/322] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:57.932519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06522ab1-a17a-4929-8eb8-4c991130490d None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:57.932811 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06522ab1-a17a-4929-8eb8-4c991130490d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:57.933070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06522ab1-a17a-4929-8eb8-4c991130490d None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:57.934408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 168/323] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:20:57.939149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490005f-c066-4f5a-9a53-d407a9b5af55 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:57.939424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490005f-c066-4f5a-9a53-d407a9b5af55 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:57.939692 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490005f-c066-4f5a-9a53-d407a9b5af55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:57.964604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b490005f-c066-4f5a-9a53-d407a9b5af55 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:20:57.965781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b490005f-c066-4f5a-9a53-d407a9b5af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:20:57.968861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67a80-1cde-4b43-ad40-a8d893c27b33 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:58.007552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ced98-40b4-4f11-9009-265e49c18ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:58.008174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ced98-40b4-4f11-9009-265e49c18ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:58.008465 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ced98-40b4-4f11-9009-265e49c18ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:58.008727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ced98-40b4-4f11-9009-265e49c18ad1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:58.021265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ced98-40b4-4f11-9009-265e49c18ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-9c6ced98-40b4-4f11-9009-265e49c18ad1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:58.026602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:58.027724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:58.031641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 156/324] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:58.033412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ced98-40b4-4f11-9009-265e49c18ad1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:58.043094 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 169/325] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:20:58.097783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:58.137812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ced98-40b4-4f11-9009-265e49c18ad1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:58.171058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59292292-cbcb-476f-97ca-c7cf5ed56cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:58.171669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59292292-cbcb-476f-97ca-c7cf5ed56cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:58.171944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59292292-cbcb-476f-97ca-c7cf5ed56cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:58.172220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59292292-cbcb-476f-97ca-c7cf5ed56cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:58.172890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59292292-cbcb-476f-97ca-c7cf5ed56cc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:58.173200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59292292-cbcb-476f-97ca-c7cf5ed56cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:58.174595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59292292-cbcb-476f-97ca-c7cf5ed56cc0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:58.187611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 157/326] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:58.188799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490005f-c066-4f5a-9a53-d407a9b5af55 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:58.242861 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:58.299355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490005f-c066-4f5a-9a53-d407a9b5af55 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:58.311381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59292292-cbcb-476f-97ca-c7cf5ed56cc0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:58.340355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc681c7e-9c37-421f-85c0-63bd63be7503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:58.340990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc681c7e-9c37-421f-85c0-63bd63be7503 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:58.341269 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc681c7e-9c37-421f-85c0-63bd63be7503 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:58.341540 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc681c7e-9c37-421f-85c0-63bd63be7503 None admin] PATH_INFO: `/v3/users/f58a8c1fa3464aa58d0ee34a9ea7fdbe` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:58.342750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc681c7e-9c37-421f-85c0-63bd63be7503 None admin] RBAC: Authorizing `identity:get_user(user_id=f58a8c1fa3464aa58d0ee34a9ea7fdbe)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:58.344192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc681c7e-9c37-421f-85c0-63bd63be7503 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:58.345933 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 170/327] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:58 2022] GET /identity/v3/users/f58a8c1fa3464aa58d0ee34a9ea7fdbe => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:58.346628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc681c7e-9c37-421f-85c0-63bd63be7503 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:58.416238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59292292-cbcb-476f-97ca-c7cf5ed56cc0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:58.442012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:58.446095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc681c7e-9c37-421f-85c0-63bd63be7503 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:58.451724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09e03-a710-42ce-ab85-06c9a7448bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:58.452369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09e03-a710-42ce-ab85-06c9a7448bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:58.452649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09e03-a710-42ce-ab85-06c9a7448bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:58.452921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09e03-a710-42ce-ab85-06c9a7448bd4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:58.464638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:58.465355 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa09e03-a710-42ce-ab85-06c9a7448bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-caa09e03-a710-42ce-ab85-06c9a7448bd4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:20:58.471413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:20:58.472307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:20:58.473115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 158/328] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:20:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:20:58.473776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09e03-a710-42ce-ab85-06c9a7448bd4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:58.488238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a83b08-6a04-492e-a2cd-48f3f2bc5c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:58.488868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a83b08-6a04-492e-a2cd-48f3f2bc5c60 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:58.489152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a83b08-6a04-492e-a2cd-48f3f2bc5c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:58.489427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a83b08-6a04-492e-a2cd-48f3f2bc5c60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:58.490524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a83b08-6a04-492e-a2cd-48f3f2bc5c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:58.492142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a83b08-6a04-492e-a2cd-48f3f2bc5c60 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:58.493879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 171/329] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:20:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:58.494494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a83b08-6a04-492e-a2cd-48f3f2bc5c60 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:58.580270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09e03-a710-42ce-ab85-06c9a7448bd4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:58.591743 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a83b08-6a04-492e-a2cd-48f3f2bc5c60 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:58.613582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc58ab-c4a8-477d-b936-6fa8ae3cdce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:58.614182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc58ab-c4a8-477d-b936-6fa8ae3cdce6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:58.614459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc58ab-c4a8-477d-b936-6fa8ae3cdce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:58.614762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc58ab-c4a8-477d-b936-6fa8ae3cdce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:58.615481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc58ab-c4a8-477d-b936-6fa8ae3cdce6 None admin] RBAC: Adding query filter params (role.id=adb2774e1d254454a97fab85c6000155, user.id=f58a8c1fa3464aa58d0ee34a9ea7fdbe, scope.system=all) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:58.615791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc58ab-c4a8-477d-b936-6fa8ae3cdce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:58.617225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc58ab-c4a8-477d-b936-6fa8ae3cdce6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:58.626495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb98bd-8f47-46f3-a7aa-4f5b2688c543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:58.627126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb98bd-8f47-46f3-a7aa-4f5b2688c543 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:58.627395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb98bd-8f47-46f3-a7aa-4f5b2688c543 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:58.627660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb98bd-8f47-46f3-a7aa-4f5b2688c543 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:58.628312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb98bd-8f47-46f3-a7aa-4f5b2688c543 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:20:58.628612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb98bd-8f47-46f3-a7aa-4f5b2688c543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:58.629950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb98bd-8f47-46f3-a7aa-4f5b2688c543 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:58.638725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 159/330] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Oct 4 08:20:58 2022] GET /identity/v3/role_assignments?user.id=f58a8c1fa3464aa58d0ee34a9ea7fdbe&scope.system=all&role.id=adb2774e1d254454a97fab85c6000155 => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:58.638725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc58ab-c4a8-477d-b936-6fa8ae3cdce6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:58.648404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 172/331] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:20:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:20:58.656209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb98bd-8f47-46f3-a7aa-4f5b2688c543 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:58.697976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:58.718734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:58.770960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc58ab-c4a8-477d-b936-6fa8ae3cdce6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:58.780835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb98bd-8f47-46f3-a7aa-4f5b2688c543 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:58.809704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab18c1-b40d-4c06-9153-06ff7bedd64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:58.810316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab18c1-b40d-4c06-9153-06ff7bedd64c None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:58.810593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab18c1-b40d-4c06-9153-06ff7bedd64c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:58.810885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab18c1-b40d-4c06-9153-06ff7bedd64c None admin] PATH_INFO: `/v3/groups` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:58.811519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab18c1-b40d-4c06-9153-06ff7bedd64c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:58.812970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab18c1-b40d-4c06-9153-06ff7bedd64c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:58.822110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72b219-8a4e-4b2c-8bb2-e8781b435998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:58.822810 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b219-8a4e-4b2c-8bb2-e8781b435998 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:58.823089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b219-8a4e-4b2c-8bb2-e8781b435998 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:58.823360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b219-8a4e-4b2c-8bb2-e8781b435998 None admin] PATH_INFO: `/v3/users/fc30c3290dab45a192404e1c7ef4563d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:58.824606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72b219-8a4e-4b2c-8bb2-e8781b435998 None admin] RBAC: Authorizing `identity:get_user(user_id=fc30c3290dab45a192404e1c7ef4563d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:58.826184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72b219-8a4e-4b2c-8bb2-e8781b435998 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:58.827756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 173/332] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:20:58 2022] GET /identity/v3/users/fc30c3290dab45a192404e1c7ef4563d => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:20:58.833942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72b219-8a4e-4b2c-8bb2-e8781b435998 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:20:58.835984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 160/333] 10.222.0.23 () {60 vars in 1134 bytes} [Tue Oct 4 08:20:58 2022] POST /identity/v3/groups => generated 226 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:20:58.954107 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72b219-8a4e-4b2c-8bb2-e8781b435998 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:20:58.968922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:20:58.993412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18fcd-d657-4ed5-a817-ce77083d3dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:20:58.994080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18fcd-d657-4ed5-a817-ce77083d3dcc None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:20:58.994362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18fcd-d657-4ed5-a817-ce77083d3dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:20:58.994634 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18fcd-d657-4ed5-a817-ce77083d3dcc None admin] PATH_INFO: `/v3/system/users/fc30c3290dab45a192404e1c7ef4563d/roles/af54b7a166d9431c8f6a2fde986f4cda` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:20:58.996207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18fcd-d657-4ed5-a817-ce77083d3dcc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fc30c3290dab45a192404e1c7ef4563d, role_id=af54b7a166d9431c8f6a2fde986f4cda)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:20:58.997612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18fcd-d657-4ed5-a817-ce77083d3dcc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:20:59.006949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 174/334] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Oct 4 08:20:58 2022] PUT /identity/v3/system/users/fc30c3290dab45a192404e1c7ef4563d/roles/af54b7a166d9431c8f6a2fde986f4cda => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:01.383273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5494f56-0db2-421f-9ff9-3dfd79adb82e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:01.383823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5494f56-0db2-421f-9ff9-3dfd79adb82e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:01.383823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5494f56-0db2-421f-9ff9-3dfd79adb82e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:01.385479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 161/335] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:01.392211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ed6b-cfdc-4736-94af-2436f87f7542 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:01.392680 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ed6b-cfdc-4736-94af-2436f87f7542 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:01.394093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ed6b-cfdc-4736-94af-2436f87f7542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:01.421112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1473ed6b-cfdc-4736-94af-2436f87f7542 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:01.422285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1473ed6b-cfdc-4736-94af-2436f87f7542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:01.523026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 175/336] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:01.812669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225219-0f16-489b-9c2f-d3ffbf90840a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:01.813059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225219-0f16-489b-9c2f-d3ffbf90840a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:01.813234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225219-0f16-489b-9c2f-d3ffbf90840a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:01.814707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 162/337] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:01.820213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352130d-0c0e-43c8-90d9-1d4029c3e3d9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:01.820494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352130d-0c0e-43c8-90d9-1d4029c3e3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:01.820768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352130d-0c0e-43c8-90d9-1d4029c3e3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:01.846359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c352130d-0c0e-43c8-90d9-1d4029c3e3d9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:01.847616 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c352130d-0c0e-43c8-90d9-1d4029c3e3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:01.933941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 176/338] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:02.119121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08225219-0f16-489b-9c2f-d3ffbf90840a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:02.128061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c1060-b206-4120-9a98-b0b478cd7da9 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:02.128648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c1060-b206-4120-9a98-b0b478cd7da9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:02.129134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c1060-b206-4120-9a98-b0b478cd7da9 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:02.130965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 177/339] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:02.141745 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779572-8dfc-4690-93a0-84b8776b0205 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:02.142376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779572-8dfc-4690-93a0-84b8776b0205 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:02.142888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779572-8dfc-4690-93a0-84b8776b0205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:02.170576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-02779572-8dfc-4690-93a0-84b8776b0205 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:02.172288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-02779572-8dfc-4690-93a0-84b8776b0205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:02.215854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:02.291034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 178/340] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:21:02.295602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08225219-0f16-489b-9c2f-d3ffbf90840a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:02.300193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:02.328512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a82c4-510f-4582-a867-5e58dee4d60e None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:02.329185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a82c4-510f-4582-a867-5e58dee4d60e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:02.329661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a82c4-510f-4582-a867-5e58dee4d60e None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:02.331646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 179/341] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:21:02.343537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cae5c-987c-4d48-a090-093fda8bc34a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:02.344145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cae5c-987c-4d48-a090-093fda8bc34a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:02.344630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cae5c-987c-4d48-a090-093fda8bc34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:02.350769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e1d83-2720-447a-908d-5b94216808f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:02.351399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1d83-2720-447a-908d-5b94216808f1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:02.351672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1d83-2720-447a-908d-5b94216808f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:02.351934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1d83-2720-447a-908d-5b94216808f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:02.374226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c88cae5c-987c-4d48-a090-093fda8bc34a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:02.377546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c88cae5c-987c-4d48-a090-093fda8bc34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:02.380260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e1d83-2720-447a-908d-5b94216808f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ac1e1d83-2720-447a-908d-5b94216808f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:02.386651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:02.387972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:21:02.388763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:02.392935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 163/342] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:02.393996 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e1d83-2720-447a-908d-5b94216808f1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:02.525002 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 180/343] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:02.525876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cae5c-987c-4d48-a090-093fda8bc34a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:02.607016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e1d83-2720-447a-908d-5b94216808f1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:02.673217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def78e0c-73df-4c54-8515-4ddb1bdeed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:02.674309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def78e0c-73df-4c54-8515-4ddb1bdeed63 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:02.674825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def78e0c-73df-4c54-8515-4ddb1bdeed63 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:02.675353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def78e0c-73df-4c54-8515-4ddb1bdeed63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:02.681065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:02.695669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cae5c-987c-4d48-a090-093fda8bc34a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:02.700965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def78e0c-73df-4c54-8515-4ddb1bdeed63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-def78e0c-73df-4c54-8515-4ddb1bdeed63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:02.714037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:02.715466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:02.717142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:02.720302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 164/344] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:02.723574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def78e0c-73df-4c54-8515-4ddb1bdeed63 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:02.769038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66661693-7f8f-485c-a9eb-017dd5d3f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:02.770012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66661693-7f8f-485c-a9eb-017dd5d3f517 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:02.770492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66661693-7f8f-485c-a9eb-017dd5d3f517 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:02.770991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66661693-7f8f-485c-a9eb-017dd5d3f517 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:02.771912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66661693-7f8f-485c-a9eb-017dd5d3f517 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:02.772512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66661693-7f8f-485c-a9eb-017dd5d3f517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:02.774277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66661693-7f8f-485c-a9eb-017dd5d3f517 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:02.776266 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:02.793658 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 181/345] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:21:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:02.794833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66661693-7f8f-485c-a9eb-017dd5d3f517 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:02.918513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def78e0c-73df-4c54-8515-4ddb1bdeed63 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:02.958028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66661693-7f8f-485c-a9eb-017dd5d3f517 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:02.964759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545507a-4ed3-41a3-ae16-b68dbec55739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:02.965671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545507a-4ed3-41a3-ae16-b68dbec55739 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:02.966187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545507a-4ed3-41a3-ae16-b68dbec55739 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:02.966743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545507a-4ed3-41a3-ae16-b68dbec55739 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:02.981982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545507a-4ed3-41a3-ae16-b68dbec55739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8545507a-4ed3-41a3-ae16-b68dbec55739 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:02.988195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:02.989152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:02.990001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:02.993107 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 165/346] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:02.994146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545507a-4ed3-41a3-ae16-b68dbec55739 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:02.995904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6449895-69a1-47ce-912c-a936c1366ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:02.995904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449895-69a1-47ce-912c-a936c1366ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:02.996115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449895-69a1-47ce-912c-a936c1366ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:02.996304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449895-69a1-47ce-912c-a936c1366ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:02.996977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6449895-69a1-47ce-912c-a936c1366ee9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:02.997287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6449895-69a1-47ce-912c-a936c1366ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:02.998689 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6449895-69a1-47ce-912c-a936c1366ee9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:03.008224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 182/347] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:21:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:03.009137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6449895-69a1-47ce-912c-a936c1366ee9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:03.037269 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:03.106956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:03.126413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545507a-4ed3-41a3-ae16-b68dbec55739 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:03.149377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6449895-69a1-47ce-912c-a936c1366ee9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:03.171895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c134da-d163-4cfe-90fb-8d2ab517ccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:03.172540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c134da-d163-4cfe-90fb-8d2ab517ccca None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:03.172909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c134da-d163-4cfe-90fb-8d2ab517ccca None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:03.173206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c134da-d163-4cfe-90fb-8d2ab517ccca None admin] PATH_INFO: `/v3/users/fc30c3290dab45a192404e1c7ef4563d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:03.174482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c134da-d163-4cfe-90fb-8d2ab517ccca None admin] RBAC: Authorizing `identity:get_user(user_id=fc30c3290dab45a192404e1c7ef4563d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:03.176233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c134da-d163-4cfe-90fb-8d2ab517ccca None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:03.179661 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 166/348] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:21:02 2022] GET /identity/v3/users/fc30c3290dab45a192404e1c7ef4563d => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:03.180501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c134da-d163-4cfe-90fb-8d2ab517ccca None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:03.190797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511703dc-9b33-4c8c-b3c1-111a2548ebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:03.191765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511703dc-9b33-4c8c-b3c1-111a2548ebc0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:03.192231 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511703dc-9b33-4c8c-b3c1-111a2548ebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:03.192709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511703dc-9b33-4c8c-b3c1-111a2548ebc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:03.209956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511703dc-9b33-4c8c-b3c1-111a2548ebc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-511703dc-9b33-4c8c-b3c1-111a2548ebc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:03.216629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:03.217571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:03.218347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 183/349] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:21:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:03.219131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef60fc-d347-423c-903a-d96107286a9b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:03.219679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef60fc-d347-423c-903a-d96107286a9b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:03.220312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef60fc-d347-423c-903a-d96107286a9b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:03.221924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 184/350] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:03.222123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef60fc-d347-423c-903a-d96107286a9b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:03.302527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c134da-d163-4cfe-90fb-8d2ab517ccca None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:03.335025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:03.350998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c274a0-7532-414a-af80-6202dd249647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:03.352032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c274a0-7532-414a-af80-6202dd249647 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:03.353529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c274a0-7532-414a-af80-6202dd249647 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:03.353529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c274a0-7532-414a-af80-6202dd249647 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:03.353529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c274a0-7532-414a-af80-6202dd249647 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:03.353529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c274a0-7532-414a-af80-6202dd249647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:03.354987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c274a0-7532-414a-af80-6202dd249647 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:03.366364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 167/351] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:21:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:03.366364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c274a0-7532-414a-af80-6202dd249647 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:03.371241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef60fc-d347-423c-903a-d96107286a9b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:03.388172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:03.414821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a459a-4208-4ee1-ad67-ab727b77bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:03.415530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a459a-4208-4ee1-ad67-ab727b77bd3f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:03.415875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a459a-4208-4ee1-ad67-ab727b77bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:03.416214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a459a-4208-4ee1-ad67-ab727b77bd3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:03.501221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a459a-4208-4ee1-ad67-ab727b77bd3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:03.502766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a459a-4208-4ee1-ad67-ab727b77bd3f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:03.518587 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c274a0-7532-414a-af80-6202dd249647 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:03.569991 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d8fbc-c508-40b8-a499-372b12d0391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:03.571003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d8fbc-c508-40b8-a499-372b12d0391a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:03.571350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d8fbc-c508-40b8-a499-372b12d0391a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:03.571636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d8fbc-c508-40b8-a499-372b12d0391a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:03.572379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d8fbc-c508-40b8-a499-372b12d0391a None admin] RBAC: Adding query filter params (role.id=af54b7a166d9431c8f6a2fde986f4cda, user.id=fc30c3290dab45a192404e1c7ef4563d, scope.system=all) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:03.572810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d8fbc-c508-40b8-a499-372b12d0391a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:03.574402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d8fbc-c508-40b8-a499-372b12d0391a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:03.589762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 168/352] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Oct 4 08:21:03 2022] GET /identity/v3/role_assignments?user.id=fc30c3290dab45a192404e1c7ef4563d&scope.system=all&role.id=af54b7a166d9431c8f6a2fde986f4cda => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:03.592085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf337f-1d72-4956-ae27-6d8f7ea1ab46 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:03.592582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf337f-1d72-4956-ae27-6d8f7ea1ab46 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:03.593083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf337f-1d72-4956-ae27-6d8f7ea1ab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:03.614290 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2ecf337f-1d72-4956-ae27-6d8f7ea1ab46 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:03.616304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2ecf337f-1d72-4956-ae27-6d8f7ea1ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:03.623371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:03.655677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 185/353] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:03.657142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a459a-4208-4ee1-ad67-ab727b77bd3f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:03.714513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 169/354] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:03.715568 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf337f-1d72-4956-ae27-6d8f7ea1ab46 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:03.721850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:03.808996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a459a-4208-4ee1-ad67-ab727b77bd3f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:03.854285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf337f-1d72-4956-ae27-6d8f7ea1ab46 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:03.857582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01123a18-e969-42e9-a74e-829e5ed68019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:03.858199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01123a18-e969-42e9-a74e-829e5ed68019 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:03.858472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01123a18-e969-42e9-a74e-829e5ed68019 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:03.859976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01123a18-e969-42e9-a74e-829e5ed68019 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:03.859976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01123a18-e969-42e9-a74e-829e5ed68019 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:03.859976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01123a18-e969-42e9-a74e-829e5ed68019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:03.861144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01123a18-e969-42e9-a74e-829e5ed68019 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:03.870746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 186/355] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:03.872079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404316c6-a656-428b-a01b-254fe06d8c14 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:03.872362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404316c6-a656-428b-a01b-254fe06d8c14 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:03.873010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404316c6-a656-428b-a01b-254fe06d8c14 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:03.874167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 187/356] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:03.878769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404316c6-a656-428b-a01b-254fe06d8c14 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:03.895698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583345f-f679-40c6-9639-2d54a894cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:03.896623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583345f-f679-40c6-9639-2d54a894cc19 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:03.896958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583345f-f679-40c6-9639-2d54a894cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:03.897614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583345f-f679-40c6-9639-2d54a894cc19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:03.936161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:03.988336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583345f-f679-40c6-9639-2d54a894cc19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:03.989733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583345f-f679-40c6-9639-2d54a894cc19 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:03.994713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:04.005890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404316c6-a656-428b-a01b-254fe06d8c14 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:04.046791 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eca877-ff60-41c4-ac50-ee156dae231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:04.047800 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eca877-ff60-41c4-ac50-ee156dae231c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:04.048294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eca877-ff60-41c4-ac50-ee156dae231c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:04.048777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eca877-ff60-41c4-ac50-ee156dae231c None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:04.050122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eca877-ff60-41c4-ac50-ee156dae231c None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:04.052143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eca877-ff60-41c4-ac50-ee156dae231c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:04.054715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 188/357] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:03 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:04.055426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eca877-ff60-41c4-ac50-ee156dae231c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:04.117527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 170/358] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:04.118746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcbe1d-c240-4dcb-9236-e03f14af97a8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:04.119119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcbe1d-c240-4dcb-9236-e03f14af97a8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:04.119401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcbe1d-c240-4dcb-9236-e03f14af97a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:04.138854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a3fcbe1d-c240-4dcb-9236-e03f14af97a8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:04.140058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a3fcbe1d-c240-4dcb-9236-e03f14af97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:04.174941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eca877-ff60-41c4-ac50-ee156dae231c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:04.187735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:04.217083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c33f7-ff00-45a0-b332-b7b4fd392349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:04.217702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c33f7-ff00-45a0-b332-b7b4fd392349 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:04.217976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c33f7-ff00-45a0-b332-b7b4fd392349 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:04.218248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c33f7-ff00-45a0-b332-b7b4fd392349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:04.219740 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 171/359] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:04.220672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcbe1d-c240-4dcb-9236-e03f14af97a8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:04.260067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:04.312943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c33f7-ff00-45a0-b332-b7b4fd392349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:04.314401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c33f7-ff00-45a0-b332-b7b4fd392349 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:04.355418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcbe1d-c240-4dcb-9236-e03f14af97a8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:04.393280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c1ce4-0966-4404-b054-d7de5aec5ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:04.394617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c1ce4-0966-4404-b054-d7de5aec5ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:04.395260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c1ce4-0966-4404-b054-d7de5aec5ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:04.395699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c1ce4-0966-4404-b054-d7de5aec5ac3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:04.411725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c1ce4-0966-4404-b054-d7de5aec5ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-837c1ce4-0966-4404-b054-d7de5aec5ac3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:04.417729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:04.418665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:04.419665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:04.422229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 172/360] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:21:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:04.423286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c1ce4-0966-4404-b054-d7de5aec5ac3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:04.450076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 189/361] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:04.454864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c33f7-ff00-45a0-b332-b7b4fd392349 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:04.478910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:04.548102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:04.554852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c1ce4-0966-4404-b054-d7de5aec5ac3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:04.596664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae44f58-ac11-4a80-8385-e2d37141d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:04.597303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae44f58-ac11-4a80-8385-e2d37141d6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:04.597589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae44f58-ac11-4a80-8385-e2d37141d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:04.597870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae44f58-ac11-4a80-8385-e2d37141d6d4 None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:04.599708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c33f7-ff00-45a0-b332-b7b4fd392349 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:04.604970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae44f58-ac11-4a80-8385-e2d37141d6d4 None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:04.607103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae44f58-ac11-4a80-8385-e2d37141d6d4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:04.608671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 173/362] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:04 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:04.609439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae44f58-ac11-4a80-8385-e2d37141d6d4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:04.641900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a9ca7-a6c4-4da6-8732-22351d3a3bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:04.643777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a9ca7-a6c4-4da6-8732-22351d3a3bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:04.643777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a9ca7-a6c4-4da6-8732-22351d3a3bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:04.643777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a9ca7-a6c4-4da6-8732-22351d3a3bd3 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:04.645152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a9ca7-a6c4-4da6-8732-22351d3a3bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:04.648105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a9ca7-a6c4-4da6-8732-22351d3a3bd3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:04.649977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 190/363] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:04 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:04.649977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a9ca7-a6c4-4da6-8732-22351d3a3bd3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:04.735347 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae44f58-ac11-4a80-8385-e2d37141d6d4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:04.747286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:04.776586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a9ca7-a6c4-4da6-8732-22351d3a3bd3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:04.784588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b51a3-5326-4245-9c6b-71172cb6976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:04.785773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b51a3-5326-4245-9c6b-71172cb6976a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:04.786089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b51a3-5326-4245-9c6b-71172cb6976a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:04.786367 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b51a3-5326-4245-9c6b-71172cb6976a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:04.787067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b51a3-5326-4245-9c6b-71172cb6976a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:04.787576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b51a3-5326-4245-9c6b-71172cb6976a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:04.789228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b51a3-5326-4245-9c6b-71172cb6976a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:04.798191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 174/364] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:04.798993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b51a3-5326-4245-9c6b-71172cb6976a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:04.817840 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54e39d-794f-4d2b-acfe-db0d4dd75e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:04.818468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54e39d-794f-4d2b-acfe-db0d4dd75e8b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:04.820646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54e39d-794f-4d2b-acfe-db0d4dd75e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:04.820646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54e39d-794f-4d2b-acfe-db0d4dd75e8b None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:04.821551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54e39d-794f-4d2b-acfe-db0d4dd75e8b None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:04.823204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54e39d-794f-4d2b-acfe-db0d4dd75e8b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:04.824826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 191/365] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:04 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:04.825581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54e39d-794f-4d2b-acfe-db0d4dd75e8b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:04.826787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:04.922206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b51a3-5326-4245-9c6b-71172cb6976a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:04.944361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54e39d-794f-4d2b-acfe-db0d4dd75e8b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:04.963500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555865e0-5d7c-4463-85ca-16bdfad29b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:04.964148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555865e0-5d7c-4463-85ca-16bdfad29b6f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:04.964426 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555865e0-5d7c-4463-85ca-16bdfad29b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:04.964697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555865e0-5d7c-4463-85ca-16bdfad29b6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:04.976311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555865e0-5d7c-4463-85ca-16bdfad29b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-555865e0-5d7c-4463-85ca-16bdfad29b6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:04.981625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:04.982530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 175/366] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:04.984077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555865e0-5d7c-4463-85ca-16bdfad29b6f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:04.987367 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c391c-5546-4712-be17-9ff64aec9b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:04.988066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c391c-5546-4712-be17-9ff64aec9b10 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:04.988349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c391c-5546-4712-be17-9ff64aec9b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:04.988621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c391c-5546-4712-be17-9ff64aec9b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:04.989358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c391c-5546-4712-be17-9ff64aec9b10 None admin] RBAC: Adding query filter params (group.id=cc106e23fd9748b4a58ec66edc406b83, role.id=adb2774e1d254454a97fab85c6000155, scope.project.id=fdf4e0e74ba94622a91171159045ae6d) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:04.989667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c391c-5546-4712-be17-9ff64aec9b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:04.991291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c391c-5546-4712-be17-9ff64aec9b10 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:04.998183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 192/367] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Oct 4 08:21:04 2022] GET /identity/v3/role_assignments?group.id=cc106e23fd9748b4a58ec66edc406b83&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=adb2774e1d254454a97fab85c6000155 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:04.999128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c391c-5546-4712-be17-9ff64aec9b10 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:05.015986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:05.098988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:05.132658 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555865e0-5d7c-4463-85ca-16bdfad29b6f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:05.152545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c391c-5546-4712-be17-9ff64aec9b10 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:05.176231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d77eb-03a1-4063-a149-63f1f34228e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:05.177265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d77eb-03a1-4063-a149-63f1f34228e1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:05.177553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d77eb-03a1-4063-a149-63f1f34228e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:05.177832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d77eb-03a1-4063-a149-63f1f34228e1 None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:05.179658 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d77eb-03a1-4063-a149-63f1f34228e1 None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:05.181688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d77eb-03a1-4063-a149-63f1f34228e1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:05.183812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 176/368] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:04 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:05.184601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d77eb-03a1-4063-a149-63f1f34228e1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:05.203947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47441e3c-3fe4-46d3-b771-d4b8e3b05d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:05.204561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47441e3c-3fe4-46d3-b771-d4b8e3b05d15 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:05.204840 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47441e3c-3fe4-46d3-b771-d4b8e3b05d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:05.205111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47441e3c-3fe4-46d3-b771-d4b8e3b05d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:05.287246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47441e3c-3fe4-46d3-b771-d4b8e3b05d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:05.289579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47441e3c-3fe4-46d3-b771-d4b8e3b05d15 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:05.295895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d77eb-03a1-4063-a149-63f1f34228e1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:05.302744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:05.336293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e299-4281-4db2-8d67-fb0e5fb84e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:05.336932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e299-4281-4db2-8d67-fb0e5fb84e96 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:05.337210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e299-4281-4db2-8d67-fb0e5fb84e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:05.337486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e299-4281-4db2-8d67-fb0e5fb84e96 None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:05.338589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6e299-4281-4db2-8d67-fb0e5fb84e96 None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:05.340071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6e299-4281-4db2-8d67-fb0e5fb84e96 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:05.341639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 177/369] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:05 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:05.342397 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e299-4281-4db2-8d67-fb0e5fb84e96 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:05.360923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:05.403078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 193/370] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:05.403929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47441e3c-3fe4-46d3-b771-d4b8e3b05d15 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:05.456749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e299-4281-4db2-8d67-fb0e5fb84e96 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:05.497528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22cf2c-c293-48c0-aae9-2e3c94410a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:05.498134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22cf2c-c293-48c0-aae9-2e3c94410a13 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:05.498416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22cf2c-c293-48c0-aae9-2e3c94410a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:05.498698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22cf2c-c293-48c0-aae9-2e3c94410a13 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:05.499381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22cf2c-c293-48c0-aae9-2e3c94410a13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:05.499680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22cf2c-c293-48c0-aae9-2e3c94410a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:05.501059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22cf2c-c293-48c0-aae9-2e3c94410a13 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:05.510462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 178/371] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:05.511283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22cf2c-c293-48c0-aae9-2e3c94410a13 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:05.524249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47441e3c-3fe4-46d3-b771-d4b8e3b05d15 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:05.535817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:05.563587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba231f-be15-4402-98d5-9237be549766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:05.564194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba231f-be15-4402-98d5-9237be549766 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:05.564477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba231f-be15-4402-98d5-9237be549766 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:05.564749 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba231f-be15-4402-98d5-9237be549766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:05.565474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba231f-be15-4402-98d5-9237be549766 None admin] RBAC: Adding query filter params (group.id=cc106e23fd9748b4a58ec66edc406b83, role.id=adb2774e1d254454a97fab85c6000155, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:05.565782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba231f-be15-4402-98d5-9237be549766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:05.567247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba231f-be15-4402-98d5-9237be549766 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:05.582958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 194/372] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Oct 4 08:21:05 2022] GET /identity/v3/role_assignments?group.id=cc106e23fd9748b4a58ec66edc406b83&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=adb2774e1d254454a97fab85c6000155 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:05.582958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba231f-be15-4402-98d5-9237be549766 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:05.612274 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:05.643478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22cf2c-c293-48c0-aae9-2e3c94410a13 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:05.694794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86df33-758a-4491-8e26-563be726fbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:05.695519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86df33-758a-4491-8e26-563be726fbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:05.696127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86df33-758a-4491-8e26-563be726fbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:05.696478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86df33-758a-4491-8e26-563be726fbc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:05.697922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86df33-758a-4491-8e26-563be726fbc7 None admin] RBAC: Adding query filter params (group.id=cc106e23fd9748b4a58ec66edc406b83, role.id=8bc105194aae4f11b5a2b917bb621f1f, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:05.698353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86df33-758a-4491-8e26-563be726fbc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:05.699873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86df33-758a-4491-8e26-563be726fbc7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:05.700207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba231f-be15-4402-98d5-9237be549766 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:05.707198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 179/373] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Oct 4 08:21:05 2022] GET /identity/v3/role_assignments?group.id=cc106e23fd9748b4a58ec66edc406b83&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=8bc105194aae4f11b5a2b917bb621f1f => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:05.708053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86df33-758a-4491-8e26-563be726fbc7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:05.753812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d677411-0205-43b9-b873-227580bd1b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:05.754468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d677411-0205-43b9-b873-227580bd1b27 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:05.754799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d677411-0205-43b9-b873-227580bd1b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:05.755075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d677411-0205-43b9-b873-227580bd1b27 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:05.756342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d677411-0205-43b9-b873-227580bd1b27 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:05.758698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d677411-0205-43b9-b873-227580bd1b27 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:05.761287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 195/374] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:05 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:05.767669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d677411-0205-43b9-b873-227580bd1b27 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:05.823823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:05.829702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86df33-758a-4491-8e26-563be726fbc7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:05.870014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8f9c-8888-47a0-b7c9-b1fc5cce4f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:05.870719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8f9c-8888-47a0-b7c9-b1fc5cce4f68 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:05.871103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8f9c-8888-47a0-b7c9-b1fc5cce4f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:05.871467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8f9c-8888-47a0-b7c9-b1fc5cce4f68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:05.884089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:05.900806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d677411-0205-43b9-b873-227580bd1b27 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:05.946031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf5334-eecb-40f8-8d3f-d4544339baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:05.946720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5334-eecb-40f8-8d3f-d4544339baea None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:05.947012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5334-eecb-40f8-8d3f-d4544339baea None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:05.947291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5334-eecb-40f8-8d3f-d4544339baea None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:05.949182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf5334-eecb-40f8-8d3f-d4544339baea None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:05.952223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf5334-eecb-40f8-8d3f-d4544339baea None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:05.952424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd8f9c-8888-47a0-b7c9-b1fc5cce4f68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:05.954768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd8f9c-8888-47a0-b7c9-b1fc5cce4f68 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:05.954949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 196/375] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:05 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:05.958601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf5334-eecb-40f8-8d3f-d4544339baea None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:06.086836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 180/376] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:06.093515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8f9c-8888-47a0-b7c9-b1fc5cce4f68 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:06.112910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf5334-eecb-40f8-8d3f-d4544339baea None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:06.135128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:06.139133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:06.192153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbc96c-8463-436a-b2aa-1eac23aea629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:06.192766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc96c-8463-436a-b2aa-1eac23aea629 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:06.193040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc96c-8463-436a-b2aa-1eac23aea629 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:06.193307 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc96c-8463-436a-b2aa-1eac23aea629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:06.194587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbc96c-8463-436a-b2aa-1eac23aea629 None admin] RBAC: Adding query filter params (group.id=cc106e23fd9748b4a58ec66edc406b83, role.id=8bc105194aae4f11b5a2b917bb621f1f, scope.project.id=fdf4e0e74ba94622a91171159045ae6d) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:06.194914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbc96c-8463-436a-b2aa-1eac23aea629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:06.196347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbc96c-8463-436a-b2aa-1eac23aea629 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:06.210514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 197/377] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Oct 4 08:21:05 2022] GET /identity/v3/role_assignments?group.id=cc106e23fd9748b4a58ec66edc406b83&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=8bc105194aae4f11b5a2b917bb621f1f => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:06.230856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8f9c-8888-47a0-b7c9-b1fc5cce4f68 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:06.277901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80d132-3e0f-42cd-b9e8-a929288ba2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:06.278936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d132-3e0f-42cd-b9e8-a929288ba2ee None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:06.279413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d132-3e0f-42cd-b9e8-a929288ba2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:06.279892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d132-3e0f-42cd-b9e8-a929288ba2ee None admin] PATH_INFO: `/v3/projects/9e3a02aac0ea474388632672a0c54b89` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:06.283487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80d132-3e0f-42cd-b9e8-a929288ba2ee None admin] RBAC: Authorizing `identity:get_project(project_id=9e3a02aac0ea474388632672a0c54b89)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:06.284992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80d132-3e0f-42cd-b9e8-a929288ba2ee None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:06.286723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 181/378] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:06 2022] GET /identity/v3/projects/9e3a02aac0ea474388632672a0c54b89 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:06.293106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbc96c-8463-436a-b2aa-1eac23aea629 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:06.423498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbc96c-8463-436a-b2aa-1eac23aea629 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:06.461342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8ca67-75af-4338-a3f8-282273b521c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:06.461976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8ca67-75af-4338-a3f8-282273b521c6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:06.462530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8ca67-75af-4338-a3f8-282273b521c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:06.462936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8ca67-75af-4338-a3f8-282273b521c6 None admin] PATH_INFO: `/v3/groups/2f75dfbb819d47b780cd44d51c7500e1` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:06.471173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8ca67-75af-4338-a3f8-282273b521c6 None admin] RBAC: Authorizing `identity:get_group(group_id=2f75dfbb819d47b780cd44d51c7500e1)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:06.471173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8ca67-75af-4338-a3f8-282273b521c6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:06.473158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 198/379] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:06 2022] GET /identity/v3/groups/2f75dfbb819d47b780cd44d51c7500e1 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:06.479105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80d132-3e0f-42cd-b9e8-a929288ba2ee None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:06.602900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80d132-3e0f-42cd-b9e8-a929288ba2ee None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:06.615089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:06.643120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77409d8c-6636-4708-801b-cbc0d0c36a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:06.643722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409d8c-6636-4708-801b-cbc0d0c36a2e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:06.643998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409d8c-6636-4708-801b-cbc0d0c36a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:06.644267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409d8c-6636-4708-801b-cbc0d0c36a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:06.644994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77409d8c-6636-4708-801b-cbc0d0c36a2e None admin] RBAC: Adding query filter params (group.id=2f75dfbb819d47b780cd44d51c7500e1, role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=9e3a02aac0ea474388632672a0c54b89) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:06.645299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77409d8c-6636-4708-801b-cbc0d0c36a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:06.646806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77409d8c-6636-4708-801b-cbc0d0c36a2e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:06.653001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 182/380] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Oct 4 08:21:06 2022] GET /identity/v3/role_assignments?group.id=2f75dfbb819d47b780cd44d51c7500e1&scope.project.id=9e3a02aac0ea474388632672a0c54b89&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:07.327975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548ea4-3d86-4f87-a713-80459bbabab6 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:07.328523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548ea4-3d86-4f87-a713-80459bbabab6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:07.328807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548ea4-3d86-4f87-a713-80459bbabab6 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:07.330474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 199/381] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:07.336571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cf53e-56af-4f1c-a04d-338e15da59c8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:07.336853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cf53e-56af-4f1c-a04d-338e15da59c8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:07.337127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cf53e-56af-4f1c-a04d-338e15da59c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:07.360313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7d2cf53e-56af-4f1c-a04d-338e15da59c8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:07.361494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7d2cf53e-56af-4f1c-a04d-338e15da59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:07.462241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 183/382] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:07.837071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32548ea4-3d86-4f87-a713-80459bbabab6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:07.888003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:07.964410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32548ea4-3d86-4f87-a713-80459bbabab6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:07.998662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce213b8-4a01-4fd2-bdc8-091a8ebe7364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:07.999321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce213b8-4a01-4fd2-bdc8-091a8ebe7364 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:07.999601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce213b8-4a01-4fd2-bdc8-091a8ebe7364 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:07.999878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce213b8-4a01-4fd2-bdc8-091a8ebe7364 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:08.010687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce213b8-4a01-4fd2-bdc8-091a8ebe7364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-cce213b8-4a01-4fd2-bdc8-091a8ebe7364 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:08.015969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:08.016846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:08.017643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 200/383] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:08.025133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cf53e-56af-4f1c-a04d-338e15da59c8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:08.165366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cf53e-56af-4f1c-a04d-338e15da59c8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:08.166856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:08.204509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e34d-ceed-4529-91cb-ee6a49de49ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:08.205172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e34d-ceed-4529-91cb-ee6a49de49ea None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:08.205453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e34d-ceed-4529-91cb-ee6a49de49ea None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:08.205779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e34d-ceed-4529-91cb-ee6a49de49ea None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:08.206435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480e34d-ceed-4529-91cb-ee6a49de49ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:08.206820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480e34d-ceed-4529-91cb-ee6a49de49ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:08.208240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480e34d-ceed-4529-91cb-ee6a49de49ea None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:08.216753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 184/384] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:21:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:08.222191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce213b8-4a01-4fd2-bdc8-091a8ebe7364 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:08.363489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:08.368457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce213b8-4a01-4fd2-bdc8-091a8ebe7364 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:08.406574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc98561-d9d8-4c6c-97dc-f71fbf4f93da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:08.407237 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98561-d9d8-4c6c-97dc-f71fbf4f93da None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:08.407514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98561-d9d8-4c6c-97dc-f71fbf4f93da None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:08.407781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98561-d9d8-4c6c-97dc-f71fbf4f93da None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:08.408955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc98561-d9d8-4c6c-97dc-f71fbf4f93da None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:08.410402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc98561-d9d8-4c6c-97dc-f71fbf4f93da None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:08.412927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 201/385] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:08 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:08.419052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e34d-ceed-4529-91cb-ee6a49de49ea None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:08.561604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e34d-ceed-4529-91cb-ee6a49de49ea None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:08.591237 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f7cba-157a-4951-a7b1-1f4bf8a4b36d None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:08.591572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f7cba-157a-4951-a7b1-1f4bf8a4b36d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:08.591781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f7cba-157a-4951-a7b1-1f4bf8a4b36d None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:08.593418 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 202/386] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:21:08.598256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecffad-03ca-49e7-8846-556f97bc4a77 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:08.598536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecffad-03ca-49e7-8846-556f97bc4a77 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:08.598849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecffad-03ca-49e7-8846-556f97bc4a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:08.608008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57df04c-8d03-4dc1-ac56-2e853a194f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:08.608950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df04c-8d03-4dc1-ac56-2e853a194f6b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:08.609434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df04c-8d03-4dc1-ac56-2e853a194f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:08.609923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df04c-8d03-4dc1-ac56-2e853a194f6b None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:08.611282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57df04c-8d03-4dc1-ac56-2e853a194f6b None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:08.613078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57df04c-8d03-4dc1-ac56-2e853a194f6b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:08.615288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 185/387] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:08 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:08.617249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035443f8-a243-44ae-a2dc-dae677f352c2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:08.617577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-98ecffad-03ca-49e7-8846-556f97bc4a77 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:08.617976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035443f8-a243-44ae-a2dc-dae677f352c2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:08.622763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-98ecffad-03ca-49e7-8846-556f97bc4a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:08.623482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035443f8-a243-44ae-a2dc-dae677f352c2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:08.625004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 186/388] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:08.625905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035443f8-a243-44ae-a2dc-dae677f352c2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:08.671590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:08.700419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 203/389] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:21:08.701818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92db84-0690-45c3-9459-4eed45a06422 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:08.702104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92db84-0690-45c3-9459-4eed45a06422 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:08.702374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92db84-0690-45c3-9459-4eed45a06422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:08.723835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5f92db84-0690-45c3-9459-4eed45a06422 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:08.725510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5f92db84-0690-45c3-9459-4eed45a06422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:08.790661 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035443f8-a243-44ae-a2dc-dae677f352c2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:08.860212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 204/390] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:08.873613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca43ad1-7748-4b32-9edf-5fb82525d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:08.874350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca43ad1-7748-4b32-9edf-5fb82525d6fe None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:08.874637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca43ad1-7748-4b32-9edf-5fb82525d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:08.874978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca43ad1-7748-4b32-9edf-5fb82525d6fe None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d/groups/cc106e23fd9748b4a58ec66edc406b83/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:08.880082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca43ad1-7748-4b32-9edf-5fb82525d6fe None admin] RBAC: Authorizing `identity:create_grant(project_id=fdf4e0e74ba94622a91171159045ae6d, group_id=cc106e23fd9748b4a58ec66edc406b83, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:08.882338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca43ad1-7748-4b32-9edf-5fb82525d6fe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:08.898082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 187/391] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Oct 4 08:21:08 2022] PUT /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d/groups/cc106e23fd9748b4a58ec66edc406b83/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:09.051544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa9d0-aba4-4680-99b0-d30240271132 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.052077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa9d0-aba4-4680-99b0-d30240271132 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.052495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa9d0-aba4-4680-99b0-d30240271132 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.055320 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 205/392] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:09.061106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975145c-135b-41bc-b6a6-77ed24380655 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.061588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975145c-135b-41bc-b6a6-77ed24380655 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.061872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975145c-135b-41bc-b6a6-77ed24380655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.081980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa9d0-aba4-4680-99b0-d30240271132 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:09.086411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a975145c-135b-41bc-b6a6-77ed24380655 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:09.087805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a975145c-135b-41bc-b6a6-77ed24380655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:09.123956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:09.171574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 188/393] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:09.219817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa9d0-aba4-4680-99b0-d30240271132 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:09.256907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea29d70-3781-4285-8e53-a2eeda51e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:09.257655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea29d70-3781-4285-8e53-a2eeda51e4fb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.257936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea29d70-3781-4285-8e53-a2eeda51e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.258243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea29d70-3781-4285-8e53-a2eeda51e4fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.271587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea29d70-3781-4285-8e53-a2eeda51e4fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-8ea29d70-3781-4285-8e53-a2eeda51e4fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:09.276975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:09.277938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:09.278756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 206/394] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:09.284601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975145c-135b-41bc-b6a6-77ed24380655 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:09.292885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea29d70-3781-4285-8e53-a2eeda51e4fb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:09.341154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:09.408876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:09.428625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea29d70-3781-4285-8e53-a2eeda51e4fb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:09.447471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975145c-135b-41bc-b6a6-77ed24380655 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:09.469935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba2b9-e84c-44fb-a858-22cc7db3df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:09.471021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba2b9-e84c-44fb-a858-22cc7db3df81 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.471504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba2b9-e84c-44fb-a858-22cc7db3df81 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.471965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba2b9-e84c-44fb-a858-22cc7db3df81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.483082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ba2b9-e84c-44fb-a858-22cc7db3df81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-df7ba2b9-e84c-44fb-a858-22cc7db3df81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:09.488577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:09.489476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:09.490272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:09.495508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 207/395] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:21:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:09.497580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bf65e-d410-4907-aeea-eb1fb4831766 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.497955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6a7eb-c7ff-425f-bcf2-3682960b2048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:09.498334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bf65e-d410-4907-aeea-eb1fb4831766 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.498580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6a7eb-c7ff-425f-bcf2-3682960b2048 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.502499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6a7eb-c7ff-425f-bcf2-3682960b2048 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.502499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6a7eb-c7ff-425f-bcf2-3682960b2048 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.502499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6a7eb-c7ff-425f-bcf2-3682960b2048 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:09.502499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6a7eb-c7ff-425f-bcf2-3682960b2048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:09.502499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6a7eb-c7ff-425f-bcf2-3682960b2048 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:09.503244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bf65e-d410-4907-aeea-eb1fb4831766 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.504409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 208/396] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:09.505008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bf65e-d410-4907-aeea-eb1fb4831766 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:09.518324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 189/397] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:21:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:09.518324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6a7eb-c7ff-425f-bcf2-3682960b2048 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:09.610720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:09.619549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bf65e-d410-4907-aeea-eb1fb4831766 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:09.632868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6a7eb-c7ff-425f-bcf2-3682960b2048 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:09.654959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9b667-e514-4aad-8e8a-76729ce1b022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:09.655585 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b667-e514-4aad-8e8a-76729ce1b022 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.655860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b667-e514-4aad-8e8a-76729ce1b022 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.656128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b667-e514-4aad-8e8a-76729ce1b022 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.666133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9b667-e514-4aad-8e8a-76729ce1b022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-42b9b667-e514-4aad-8e8a-76729ce1b022 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:09.671036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:09.672120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:09.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 209/398] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:21:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:09.673580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea80b-97a6-473b-86f4-d1448fa79be6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.673821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea80b-97a6-473b-86f4-d1448fa79be6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.674092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea80b-97a6-473b-86f4-d1448fa79be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.677009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441bf3f-f32a-4aa1-8d6e-0fbcf0f48a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:09.678393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441bf3f-f32a-4aa1-8d6e-0fbcf0f48a02 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.678917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441bf3f-f32a-4aa1-8d6e-0fbcf0f48a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.679188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441bf3f-f32a-4aa1-8d6e-0fbcf0f48a02 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.679923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441bf3f-f32a-4aa1-8d6e-0fbcf0f48a02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:09.680231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441bf3f-f32a-4aa1-8d6e-0fbcf0f48a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:09.681681 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441bf3f-f32a-4aa1-8d6e-0fbcf0f48a02 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:09.688602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:09.697170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 190/399] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:09.697170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441bf3f-f32a-4aa1-8d6e-0fbcf0f48a02 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:09.697383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6e0ea80b-97a6-473b-86f4-d1448fa79be6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:09.697383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6e0ea80b-97a6-473b-86f4-d1448fa79be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:09.767815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 210/400] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:09.768722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ea80b-97a6-473b-86f4-d1448fa79be6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:09.800528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441bf3f-f32a-4aa1-8d6e-0fbcf0f48a02 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:09.847424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543f4ae-fbdc-4b2a-ba23-a1cedfc7fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:09.848086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f4ae-fbdc-4b2a-ba23-a1cedfc7fad0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.848372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f4ae-fbdc-4b2a-ba23-a1cedfc7fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.848645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f4ae-fbdc-4b2a-ba23-a1cedfc7fad0 None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.849828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543f4ae-fbdc-4b2a-ba23-a1cedfc7fad0 None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:09.852745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543f4ae-fbdc-4b2a-ba23-a1cedfc7fad0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:09.854797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 191/401] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:09 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:09.860491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543f4ae-fbdc-4b2a-ba23-a1cedfc7fad0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:09.884478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:09.892521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ea80b-97a6-473b-86f4-d1448fa79be6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:09.940086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426d343-5041-4cbc-97f7-537a969584f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:09.941050 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426d343-5041-4cbc-97f7-537a969584f6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:09.941601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426d343-5041-4cbc-97f7-537a969584f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:09.943006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426d343-5041-4cbc-97f7-537a969584f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:09.944405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426d343-5041-4cbc-97f7-537a969584f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:09.945096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426d343-5041-4cbc-97f7-537a969584f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:09.946883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426d343-5041-4cbc-97f7-537a969584f6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:09.950062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:09.958776 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 211/402] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:09.960848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426d343-5041-4cbc-97f7-537a969584f6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:10.006787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543f4ae-fbdc-4b2a-ba23-a1cedfc7fad0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.052513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c60ae-b775-4932-ba73-d3d7644d0561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.053317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c60ae-b775-4932-ba73-d3d7644d0561 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.053778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c60ae-b775-4932-ba73-d3d7644d0561 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.054055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c60ae-b775-4932-ba73-d3d7644d0561 None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.055235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c60ae-b775-4932-ba73-d3d7644d0561 None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:10.056666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c60ae-b775-4932-ba73-d3d7644d0561 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:10.062971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 192/403] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:09 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:10.062971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c60ae-b775-4932-ba73-d3d7644d0561 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:10.075469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426d343-5041-4cbc-97f7-537a969584f6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.111991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d85a-b36b-47ed-b58b-def8468bb844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.112619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d85a-b36b-47ed-b58b-def8468bb844 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.112902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d85a-b36b-47ed-b58b-def8468bb844 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.113182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d85a-b36b-47ed-b58b-def8468bb844 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.114314 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4d85a-b36b-47ed-b58b-def8468bb844 None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:10.115912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4d85a-b36b-47ed-b58b-def8468bb844 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:10.122737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 212/404] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:09 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:10.122737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d85a-b36b-47ed-b58b-def8468bb844 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:10.148554 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:10.168494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c60ae-b775-4932-ba73-d3d7644d0561 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.192117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:10.203945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75180856-241d-4820-9173-6dd4b20603ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.204809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75180856-241d-4820-9173-6dd4b20603ba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.205088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75180856-241d-4820-9173-6dd4b20603ba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.205362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75180856-241d-4820-9173-6dd4b20603ba None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.206504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75180856-241d-4820-9173-6dd4b20603ba None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:10.208066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75180856-241d-4820-9173-6dd4b20603ba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:10.210358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 193/405] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:10 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:10.211810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75180856-241d-4820-9173-6dd4b20603ba None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:10.230469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d85a-b36b-47ed-b58b-def8468bb844 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.266262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25f4c-f8ea-4cbb-9c72-d1a71c27067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.266942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25f4c-f8ea-4cbb-9c72-d1a71c27067f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.267222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25f4c-f8ea-4cbb-9c72-d1a71c27067f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.267493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25f4c-f8ea-4cbb-9c72-d1a71c27067f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.278512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb25f4c-f8ea-4cbb-9c72-d1a71c27067f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-6bb25f4c-f8ea-4cbb-9c72-d1a71c27067f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:10.283345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:10.284347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:10.285148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 213/406] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:10.285808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25f4c-f8ea-4cbb-9c72-d1a71c27067f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:10.324803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75180856-241d-4820-9173-6dd4b20603ba None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.360048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9b29a-f0dd-44d9-96a4-e8859cdca949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.360710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b29a-f0dd-44d9-96a4-e8859cdca949 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.360967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b29a-f0dd-44d9-96a4-e8859cdca949 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.361244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b29a-f0dd-44d9-96a4-e8859cdca949 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.362372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9b29a-f0dd-44d9-96a4-e8859cdca949 None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:10.363845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9b29a-f0dd-44d9-96a4-e8859cdca949 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:10.365967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 194/407] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:10 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:10.366748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9b29a-f0dd-44d9-96a4-e8859cdca949 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:10.391440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:10.404406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25f4c-f8ea-4cbb-9c72-d1a71c27067f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.437561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:10.449077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310c4e-3ab0-48fb-8ff7-59dcd5eabdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.450011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310c4e-3ab0-48fb-8ff7-59dcd5eabdb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.450541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310c4e-3ab0-48fb-8ff7-59dcd5eabdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.450850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310c4e-3ab0-48fb-8ff7-59dcd5eabdb6 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/groups/cc106e23fd9748b4a58ec66edc406b83/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.455303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3310c4e-3ab0-48fb-8ff7-59dcd5eabdb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f765e7077fd48a9a2c1f5169c76b008, group_id=cc106e23fd9748b4a58ec66edc406b83, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:10.456878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3310c4e-3ab0-48fb-8ff7-59dcd5eabdb6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:10.471709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 214/408] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Oct 4 08:21:10 2022] PUT /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/groups/cc106e23fd9748b4a58ec66edc406b83/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:10.472588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310c4e-3ab0-48fb-8ff7-59dcd5eabdb6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:10.497359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9b29a-f0dd-44d9-96a4-e8859cdca949 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.541803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f4d99-eb09-44f9-abb9-0e72ce6c8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.542838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4d99-eb09-44f9-abb9-0e72ce6c8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.543396 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4d99-eb09-44f9-abb9-0e72ce6c8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.544055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4d99-eb09-44f9-abb9-0e72ce6c8cb2 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.545534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f4d99-eb09-44f9-abb9-0e72ce6c8cb2 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:10.547478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f4d99-eb09-44f9-abb9-0e72ce6c8cb2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:10.549959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 195/409] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:10 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:10.551330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f4d99-eb09-44f9-abb9-0e72ce6c8cb2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:10.585712 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310c4e-3ab0-48fb-8ff7-59dcd5eabdb6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.623095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d469d-2854-42ad-a187-2fe8bc79dafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.623711 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d469d-2854-42ad-a187-2fe8bc79dafd None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.623986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d469d-2854-42ad-a187-2fe8bc79dafd None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.624253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d469d-2854-42ad-a187-2fe8bc79dafd None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.624928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d469d-2854-42ad-a187-2fe8bc79dafd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:10.625294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d469d-2854-42ad-a187-2fe8bc79dafd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:10.626633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d469d-2854-42ad-a187-2fe8bc79dafd None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:10.636864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 215/410] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:10.637783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d469d-2854-42ad-a187-2fe8bc79dafd None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:10.658233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:10.679569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f4d99-eb09-44f9-abb9-0e72ce6c8cb2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.691888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:10.732546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11baf-1ffd-4b4c-8c67-829fa31b0215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.733881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11baf-1ffd-4b4c-8c67-829fa31b0215 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.734640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11baf-1ffd-4b4c-8c67-829fa31b0215 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.735169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11baf-1ffd-4b4c-8c67-829fa31b0215 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/groups/cc106e23fd9748b4a58ec66edc406b83/roles/8bc105194aae4f11b5a2b917bb621f1f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.737984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a11baf-1ffd-4b4c-8c67-829fa31b0215 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f765e7077fd48a9a2c1f5169c76b008, group_id=cc106e23fd9748b4a58ec66edc406b83, role_id=8bc105194aae4f11b5a2b917bb621f1f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:10.741183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a11baf-1ffd-4b4c-8c67-829fa31b0215 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:10.753694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d469d-2854-42ad-a187-2fe8bc79dafd None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.766714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 196/411] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Oct 4 08:21:10 2022] PUT /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008/groups/cc106e23fd9748b4a58ec66edc406b83/roles/8bc105194aae4f11b5a2b917bb621f1f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:10.766714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11baf-1ffd-4b4c-8c67-829fa31b0215 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:10.821506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22979b0-a2c8-4a87-add8-1486a95aba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.822185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22979b0-a2c8-4a87-add8-1486a95aba76 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.822722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22979b0-a2c8-4a87-add8-1486a95aba76 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.822970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22979b0-a2c8-4a87-add8-1486a95aba76 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d/groups/cc106e23fd9748b4a58ec66edc406b83/roles/8bc105194aae4f11b5a2b917bb621f1f` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.827984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22979b0-a2c8-4a87-add8-1486a95aba76 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdf4e0e74ba94622a91171159045ae6d, group_id=cc106e23fd9748b4a58ec66edc406b83, role_id=8bc105194aae4f11b5a2b917bb621f1f)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:10.830879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22979b0-a2c8-4a87-add8-1486a95aba76 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:10.859391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 216/412] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Oct 4 08:21:10 2022] PUT /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d/groups/cc106e23fd9748b4a58ec66edc406b83/roles/8bc105194aae4f11b5a2b917bb621f1f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:10.942991 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11baf-1ffd-4b4c-8c67-829fa31b0215 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:10.987350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d73c3-19e0-44ee-835a-7c9ea8b6eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:10.988000 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d73c3-19e0-44ee-835a-7c9ea8b6eccc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:10.988281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d73c3-19e0-44ee-835a-7c9ea8b6eccc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:10.988556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d73c3-19e0-44ee-835a-7c9ea8b6eccc None admin] PATH_INFO: `/v3/groups/2f75dfbb819d47b780cd44d51c7500e1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:10.989703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d73c3-19e0-44ee-835a-7c9ea8b6eccc None admin] RBAC: Authorizing `identity:get_group(group_id=2f75dfbb819d47b780cd44d51c7500e1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:10.991362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d73c3-19e0-44ee-835a-7c9ea8b6eccc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:10.993008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 197/413] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:10 2022] GET /identity/v3/groups/2f75dfbb819d47b780cd44d51c7500e1 => generated 229 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:10.998951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22979b0-a2c8-4a87-add8-1486a95aba76 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:11.132588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22979b0-a2c8-4a87-add8-1486a95aba76 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:11.146726 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:11.186138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16ebd1-d33d-4eed-baab-0448a3169add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:11.187120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16ebd1-d33d-4eed-baab-0448a3169add None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:11.187562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16ebd1-d33d-4eed-baab-0448a3169add None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:11.187974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16ebd1-d33d-4eed-baab-0448a3169add None admin] PATH_INFO: `/v3/projects/9e3a02aac0ea474388632672a0c54b89` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:11.190066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16ebd1-d33d-4eed-baab-0448a3169add None admin] RBAC: Authorizing `identity:get_project(project_id=9e3a02aac0ea474388632672a0c54b89)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:11.191769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16ebd1-d33d-4eed-baab-0448a3169add None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:11.194319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 217/414] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:10 2022] GET /identity/v3/projects/9e3a02aac0ea474388632672a0c54b89 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:11.200478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d73c3-19e0-44ee-835a-7c9ea8b6eccc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:11.223284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:11.355041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582213e4-e4c0-4526-aa1e-190d2831f822 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:11.355551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582213e4-e4c0-4526-aa1e-190d2831f822 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:11.355989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582213e4-e4c0-4526-aa1e-190d2831f822 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:11.357445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 218/415] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:21:11.366406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d73c3-19e0-44ee-835a-7c9ea8b6eccc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:11.372490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa728a-36c3-4417-bf9a-efcdaf652c40 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:11.372782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa728a-36c3-4417-bf9a-efcdaf652c40 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:11.373062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa728a-36c3-4417-bf9a-efcdaf652c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:11.406764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b7aa728a-36c3-4417-bf9a-efcdaf652c40 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:11.406764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b7aa728a-36c3-4417-bf9a-efcdaf652c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:11.419574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec78d82-650d-4957-9098-0209d131f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:11.420626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec78d82-650d-4957-9098-0209d131f800 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:11.420909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec78d82-650d-4957-9098-0209d131f800 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:11.421177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec78d82-650d-4957-9098-0209d131f800 None admin] PATH_INFO: `/v3/projects/9e3a02aac0ea474388632672a0c54b89/groups/2f75dfbb819d47b780cd44d51c7500e1/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:11.424067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec78d82-650d-4957-9098-0209d131f800 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e3a02aac0ea474388632672a0c54b89, group_id=2f75dfbb819d47b780cd44d51c7500e1, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:11.425892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec78d82-650d-4957-9098-0209d131f800 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:11.446931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 198/416] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Oct 4 08:21:11 2022] PUT /identity/v3/projects/9e3a02aac0ea474388632672a0c54b89/groups/2f75dfbb819d47b780cd44d51c7500e1/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:11.503098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 219/417] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:11.900880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec78d82-650d-4957-9098-0209d131f800 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:12.001134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:12.039147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec78d82-650d-4957-9098-0209d131f800 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:12.086956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132e126-7233-409e-ae55-d88158e6df47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:12.087592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e126-7233-409e-ae55-d88158e6df47 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:12.087875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e126-7233-409e-ae55-d88158e6df47 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:12.088148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e126-7233-409e-ae55-d88158e6df47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:12.104577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132e126-7233-409e-ae55-d88158e6df47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d132e126-7233-409e-ae55-d88158e6df47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:12.109886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:12.110777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:12.111596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 199/418] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:12.117272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa728a-36c3-4417-bf9a-efcdaf652c40 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:12.264292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa728a-36c3-4417-bf9a-efcdaf652c40 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:12.277493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:12.314876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225c704-3551-4536-ab08-ec4f223cef97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:12.315485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225c704-3551-4536-ab08-ec4f223cef97 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:12.315764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225c704-3551-4536-ab08-ec4f223cef97 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:12.316037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225c704-3551-4536-ab08-ec4f223cef97 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:12.316705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225c704-3551-4536-ab08-ec4f223cef97 None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:12.317009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225c704-3551-4536-ab08-ec4f223cef97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:12.318938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225c704-3551-4536-ab08-ec4f223cef97 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:12.330307 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 220/419] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:21:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:12.336503 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132e126-7233-409e-ae55-d88158e6df47 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:12.508820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132e126-7233-409e-ae55-d88158e6df47 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:12.558016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b722a-820a-46a6-81c9-255bf2edb01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:12.558559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b722a-820a-46a6-81c9-255bf2edb01d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:12.558868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b722a-820a-46a6-81c9-255bf2edb01d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:12.559147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b722a-820a-46a6-81c9-255bf2edb01d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:12.561774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:12.650211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b722a-820a-46a6-81c9-255bf2edb01d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:12.651748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b722a-820a-46a6-81c9-255bf2edb01d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:12.786616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 200/420] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:12.792963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225c704-3551-4536-ab08-ec4f223cef97 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:12.954400 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225c704-3551-4536-ab08-ec4f223cef97 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:13.007584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7493a-18f3-4b0b-8ea6-70276a26eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:13.008599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7493a-18f3-4b0b-8ea6-70276a26eca3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:13.009086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7493a-18f3-4b0b-8ea6-70276a26eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:13.009581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7493a-18f3-4b0b-8ea6-70276a26eca3 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:13.011048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7493a-18f3-4b0b-8ea6-70276a26eca3 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:13.012690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7493a-18f3-4b0b-8ea6-70276a26eca3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:13.014874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 221/421] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:12 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:13.020753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b722a-820a-46a6-81c9-255bf2edb01d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:13.078720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:13.153227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b722a-820a-46a6-81c9-255bf2edb01d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:13.171968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba85ce-1ed1-40f6-bf0d-a5765fb5f741 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:13.172272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba85ce-1ed1-40f6-bf0d-a5765fb5f741 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:13.172519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba85ce-1ed1-40f6-bf0d-a5765fb5f741 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:13.174099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 222/422] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:13.179875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ea4d8-703d-4177-9221-c7d04d23e4fa None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:13.180156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ea4d8-703d-4177-9221-c7d04d23e4fa None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:13.180429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ea4d8-703d-4177-9221-c7d04d23e4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:13.202455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dc3ea4d8-703d-4177-9221-c7d04d23e4fa None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:13.203689 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dc3ea4d8-703d-4177-9221-c7d04d23e4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:13.208347 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042db03-49f6-40d1-9034-c66fe63c5893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:13.208914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042db03-49f6-40d1-9034-c66fe63c5893 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:13.209805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042db03-49f6-40d1-9034-c66fe63c5893 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:13.210623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042db03-49f6-40d1-9034-c66fe63c5893 None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:13.211921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042db03-49f6-40d1-9034-c66fe63c5893 None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:13.213390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042db03-49f6-40d1-9034-c66fe63c5893 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:13.219702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 201/423] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:13 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:13.221665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042db03-49f6-40d1-9034-c66fe63c5893 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:13.270783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:13.340319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 223/424] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:13.385193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042db03-49f6-40d1-9034-c66fe63c5893 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:13.386846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:13.430206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c90b-9d36-4850-a024-f0bd99cf8734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:13.430889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c90b-9d36-4850-a024-f0bd99cf8734 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:13.431172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c90b-9d36-4850-a024-f0bd99cf8734 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:13.431443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c90b-9d36-4850-a024-f0bd99cf8734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:13.432232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c90b-9d36-4850-a024-f0bd99cf8734 None admin] RBAC: Adding query filter params (group.id=cc106e23fd9748b4a58ec66edc406b83, role.id=adb2774e1d254454a97fab85c6000155, scope.project.id=fdf4e0e74ba94622a91171159045ae6d) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:13.432545 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c90b-9d36-4850-a024-f0bd99cf8734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:13.434007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c90b-9d36-4850-a024-f0bd99cf8734 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:13.443108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 202/425] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Oct 4 08:21:13 2022] GET /identity/v3/role_assignments?group.id=cc106e23fd9748b4a58ec66edc406b83&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=adb2774e1d254454a97fab85c6000155 => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:13.460858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6ab03-e4b1-48cf-9413-6504b4366ec9 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:13.461052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6ab03-e4b1-48cf-9413-6504b4366ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:13.461305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6ab03-e4b1-48cf-9413-6504b4366ec9 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:13.462739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 224/426] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:13.473651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8674c-3b20-43d3-bf6c-d799e9d0f030 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:13.473947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8674c-3b20-43d3-bf6c-d799e9d0f030 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:13.474225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8674c-3b20-43d3-bf6c-d799e9d0f030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:13.500611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-47b8674c-3b20-43d3-bf6c-d799e9d0f030 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:13.501806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-47b8674c-3b20-43d3-bf6c-d799e9d0f030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:13.594814 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 203/427] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:13.665813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8a566-4b97-40a6-b1be-7cd41ae1f7b7 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:13.666586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8a566-4b97-40a6-b1be-7cd41ae1f7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:13.667080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8a566-4b97-40a6-b1be-7cd41ae1f7b7 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:13.668628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 225/428] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:13.674330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49293a-bbb8-4c83-b03e-dbea214d3dc7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:13.674624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49293a-bbb8-4c83-b03e-dbea214d3dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:13.674939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49293a-bbb8-4c83-b03e-dbea214d3dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:13.694868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cb49293a-bbb8-4c83-b03e-dbea214d3dc7 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:13.696091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cb49293a-bbb8-4c83-b03e-dbea214d3dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:13.777436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 204/429] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:13.792848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8a566-4b97-40a6-b1be-7cd41ae1f7b7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:13.878184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49293a-bbb8-4c83-b03e-dbea214d3dc7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:13.911398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8a566-4b97-40a6-b1be-7cd41ae1f7b7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:13.912417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:13.954964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a0b84-990c-4094-bb43-9bd372754682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:13.955614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a0b84-990c-4094-bb43-9bd372754682 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:13.955873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a0b84-990c-4094-bb43-9bd372754682 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:13.956138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a0b84-990c-4094-bb43-9bd372754682 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:13.969319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a0b84-990c-4094-bb43-9bd372754682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-639a0b84-990c-4094-bb43-9bd372754682 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:13.976259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:13.977161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:21:13.977948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:13.980613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 226/430] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:13.987178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a0b84-990c-4094-bb43-9bd372754682 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:14.012213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49293a-bbb8-4c83-b03e-dbea214d3dc7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:14.047125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:14.055158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a589-69c3-4d55-96fb-04d3c2aa95d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:14.055799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a589-69c3-4d55-96fb-04d3c2aa95d4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.056078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a589-69c3-4d55-96fb-04d3c2aa95d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.056349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a589-69c3-4d55-96fb-04d3c2aa95d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.070103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58a589-69c3-4d55-96fb-04d3c2aa95d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3e58a589-69c3-4d55-96fb-04d3c2aa95d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:14.076321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:14.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:14.078057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:14.078709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 205/431] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:21:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:14.079277 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a589-69c3-4d55-96fb-04d3c2aa95d4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:14.107010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a0b84-990c-4094-bb43-9bd372754682 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:14.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44006790-a594-42b1-8fd5-6b40054ad7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:14.143170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44006790-a594-42b1-8fd5-6b40054ad7ac None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.143449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44006790-a594-42b1-8fd5-6b40054ad7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.143721 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44006790-a594-42b1-8fd5-6b40054ad7ac None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.144382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44006790-a594-42b1-8fd5-6b40054ad7ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:14.144686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44006790-a594-42b1-8fd5-6b40054ad7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:14.146058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44006790-a594-42b1-8fd5-6b40054ad7ac None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:14.158957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 227/432] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:21:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:14.158957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44006790-a594-42b1-8fd5-6b40054ad7ac None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:14.182575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:14.198529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a589-69c3-4d55-96fb-04d3c2aa95d4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:14.234605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d49c-d359-4b97-9332-1b13aa2e6ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:14.235262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d49c-d359-4b97-9332-1b13aa2e6ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.235543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d49c-d359-4b97-9332-1b13aa2e6ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.235813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d49c-d359-4b97-9332-1b13aa2e6ae3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.246763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339d49c-d359-4b97-9332-1b13aa2e6ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:14.251221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e339d49c-d359-4b97-9332-1b13aa2e6ae3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:14.252104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:14.253069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 206/433] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:21:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:14.253874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d49c-d359-4b97-9332-1b13aa2e6ae3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:14.269919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44006790-a594-42b1-8fd5-6b40054ad7ac None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:14.307831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3b672-60f9-4cf7-b855-4004630eae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:14.308355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3b672-60f9-4cf7-b855-4004630eae24 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.308636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3b672-60f9-4cf7-b855-4004630eae24 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.308910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3b672-60f9-4cf7-b855-4004630eae24 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.309599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3b672-60f9-4cf7-b855-4004630eae24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:14.309909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3b672-60f9-4cf7-b855-4004630eae24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:14.311381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3b672-60f9-4cf7-b855-4004630eae24 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:14.321801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 228/434] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:14.327312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3b672-60f9-4cf7-b855-4004630eae24 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:14.368484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d49c-d359-4b97-9332-1b13aa2e6ae3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:14.404522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b36695-caed-4241-8f93-2b0509b60405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:14.405922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b36695-caed-4241-8f93-2b0509b60405 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.406436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b36695-caed-4241-8f93-2b0509b60405 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.406809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b36695-caed-4241-8f93-2b0509b60405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.423458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:14.433484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3b672-60f9-4cf7-b855-4004630eae24 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:14.467859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e178e-4a2d-49e7-b323-7742134d37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:14.468891 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e178e-4a2d-49e7-b323-7742134d37ac None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.469056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e178e-4a2d-49e7-b323-7742134d37ac None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.469329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e178e-4a2d-49e7-b323-7742134d37ac None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.469998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e178e-4a2d-49e7-b323-7742134d37ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:14.470305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e178e-4a2d-49e7-b323-7742134d37ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:14.471705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e178e-4a2d-49e7-b323-7742134d37ac None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:14.477976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b36695-caed-4241-8f93-2b0509b60405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:14.479463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b36695-caed-4241-8f93-2b0509b60405 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:14.480202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 229/435] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:14.480999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e178e-4a2d-49e7-b323-7742134d37ac None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:14.499958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:14.582386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 207/436] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:14.583605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8046c1-c876-43d7-b416-6286be01b2cd None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.583920 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8046c1-c876-43d7-b416-6286be01b2cd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.584365 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8046c1-c876-43d7-b416-6286be01b2cd None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.585790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 208/437] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:14.586490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8046c1-c876-43d7-b416-6286be01b2cd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:14.598293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e178e-4a2d-49e7-b323-7742134d37ac None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:14.632780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c45b4-2b52-4546-ad9a-d0febc282334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:14.633380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c45b4-2b52-4546-ad9a-d0febc282334 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.633655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c45b4-2b52-4546-ad9a-d0febc282334 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.633925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c45b4-2b52-4546-ad9a-d0febc282334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.634996 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:14.690810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8046c1-c876-43d7-b416-6286be01b2cd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:14.702767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c45b4-2b52-4546-ad9a-d0febc282334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:14.704247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c45b4-2b52-4546-ad9a-d0febc282334 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:14.718195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:14.726213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8ccfb-684f-4481-8c2b-7ee70c8f54e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:14.726849 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ccfb-684f-4481-8c2b-7ee70c8f54e0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.727134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ccfb-684f-4481-8c2b-7ee70c8f54e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.727407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ccfb-684f-4481-8c2b-7ee70c8f54e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.796842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ccfb-684f-4481-8c2b-7ee70c8f54e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:14.798289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ccfb-684f-4481-8c2b-7ee70c8f54e0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:14.805071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 230/438] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:14.806004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c45b4-2b52-4546-ad9a-d0febc282334 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:14.845009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:14.902722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 209/439] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:14.903909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4d0ef-7a36-45d4-a94d-60f9253753a7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.904509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4d0ef-7a36-45d4-a94d-60f9253753a7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.904790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4d0ef-7a36-45d4-a94d-60f9253753a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.906966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c45b4-2b52-4546-ad9a-d0febc282334 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:14.920298 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:14.923159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-36c4d0ef-7a36-45d4-a94d-60f9253753a7 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:14.924425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-36c4d0ef-7a36-45d4-a94d-60f9253753a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:14.941681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad407188-0463-4c6d-afa8-bfe880b8d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:14.942297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407188-0463-4c6d-afa8-bfe880b8d8ce None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:14.942576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407188-0463-4c6d-afa8-bfe880b8d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:14.942877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407188-0463-4c6d-afa8-bfe880b8d8ce None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:14.944014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad407188-0463-4c6d-afa8-bfe880b8d8ce None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:14.945442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad407188-0463-4c6d-afa8-bfe880b8d8ce None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:14.947093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 231/440] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:14 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:14.947846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad407188-0463-4c6d-afa8-bfe880b8d8ce None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:14.995151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 210/441] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:14.995990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4d0ef-7a36-45d4-a94d-60f9253753a7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:15.054834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad407188-0463-4c6d-afa8-bfe880b8d8ce None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.077716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:15.094176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96b6f-aabe-4c75-945d-4181e3603f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.094910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96b6f-aabe-4c75-945d-4181e3603f26 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.095238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96b6f-aabe-4c75-945d-4181e3603f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.095461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96b6f-aabe-4c75-945d-4181e3603f26 None admin] PATH_INFO: `/v3/projects/fdf4e0e74ba94622a91171159045ae6d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:15.096561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a96b6f-aabe-4c75-945d-4181e3603f26 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf4e0e74ba94622a91171159045ae6d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:15.097977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a96b6f-aabe-4c75-945d-4181e3603f26 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:15.100166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 232/442] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:14 2022] GET /identity/v3/projects/fdf4e0e74ba94622a91171159045ae6d => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:15.101998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4d0ef-7a36-45d4-a94d-60f9253753a7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.105479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96b6f-aabe-4c75-945d-4181e3603f26 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:15.139353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9c450-2ca3-420b-b837-9fe8a8d3ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.140089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9c450-2ca3-420b-b837-9fe8a8d3ba81 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.140369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9c450-2ca3-420b-b837-9fe8a8d3ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.140641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9c450-2ca3-420b-b837-9fe8a8d3ba81 None admin] PATH_INFO: `/v3/projects/6f765e7077fd48a9a2c1f5169c76b008` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:15.141763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9c450-2ca3-420b-b837-9fe8a8d3ba81 None admin] RBAC: Authorizing `identity:get_project(project_id=6f765e7077fd48a9a2c1f5169c76b008)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:15.143246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9c450-2ca3-420b-b837-9fe8a8d3ba81 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:15.144974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 211/443] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:14 2022] GET /identity/v3/projects/6f765e7077fd48a9a2c1f5169c76b008 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:15.145729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9c450-2ca3-420b-b837-9fe8a8d3ba81 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:15.159342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:15.217935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96b6f-aabe-4c75-945d-4181e3603f26 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.246482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9c450-2ca3-420b-b837-9fe8a8d3ba81 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.253871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ec75-619b-4e96-963f-7f40c7d43e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.254504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ec75-619b-4e96-963f-7f40c7d43e44 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.254813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ec75-619b-4e96-963f-7f40c7d43e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.255083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ec75-619b-4e96-963f-7f40c7d43e44 None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:15.256723 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907ec75-619b-4e96-963f-7f40c7d43e44 None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:15.258149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907ec75-619b-4e96-963f-7f40c7d43e44 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:15.259919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 233/444] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:15 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:15.260729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ec75-619b-4e96-963f-7f40c7d43e44 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:15.284566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7754f-cbd3-4fde-a065-c64a0c70a5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.285182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7754f-cbd3-4fde-a065-c64a0c70a5bc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.285454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7754f-cbd3-4fde-a065-c64a0c70a5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.285722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7754f-cbd3-4fde-a065-c64a0c70a5bc None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:15.286847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7754f-cbd3-4fde-a065-c64a0c70a5bc None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:15.288793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7754f-cbd3-4fde-a065-c64a0c70a5bc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:15.290331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 212/445] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:15 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:15.291103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7754f-cbd3-4fde-a065-c64a0c70a5bc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:15.309123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:15.358296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ec75-619b-4e96-963f-7f40c7d43e44 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.374614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:15.391945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7754f-cbd3-4fde-a065-c64a0c70a5bc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.392336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93edde-32bf-4f9f-b4a2-81d5649b5fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.392967 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93edde-32bf-4f9f-b4a2-81d5649b5fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.393251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93edde-32bf-4f9f-b4a2-81d5649b5fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.393518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93edde-32bf-4f9f-b4a2-81d5649b5fd0 None admin] PATH_INFO: `/v3/groups/cc106e23fd9748b4a58ec66edc406b83` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:15.395374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93edde-32bf-4f9f-b4a2-81d5649b5fd0 None admin] RBAC: Authorizing `identity:get_group(group_id=cc106e23fd9748b4a58ec66edc406b83)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:15.396843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93edde-32bf-4f9f-b4a2-81d5649b5fd0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:15.398445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 234/446] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:15 2022] GET /identity/v3/groups/cc106e23fd9748b4a58ec66edc406b83 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:15.399646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93edde-32bf-4f9f-b4a2-81d5649b5fd0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:15.426558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb670795-f534-4f81-a49a-b3c93020eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.427194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb670795-f534-4f81-a49a-b3c93020eee8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.427469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb670795-f534-4f81-a49a-b3c93020eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.428471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb670795-f534-4f81-a49a-b3c93020eee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:15.438379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb670795-f534-4f81-a49a-b3c93020eee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-bb670795-f534-4f81-a49a-b3c93020eee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:15.443126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:15.444286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:15.445082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 213/447] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:15.445747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb670795-f534-4f81-a49a-b3c93020eee8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:15.507014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93edde-32bf-4f9f-b4a2-81d5649b5fd0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.515310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:15.542341 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4e118-b991-4529-aea7-ae5ccf75d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.542972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4e118-b991-4529-aea7-ae5ccf75d831 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.543251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4e118-b991-4529-aea7-ae5ccf75d831 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.543517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4e118-b991-4529-aea7-ae5ccf75d831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:15.544239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4e118-b991-4529-aea7-ae5ccf75d831 None admin] RBAC: Adding query filter params (group.id=cc106e23fd9748b4a58ec66edc406b83, role.id=adb2774e1d254454a97fab85c6000155, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:15.544546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4e118-b991-4529-aea7-ae5ccf75d831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:15.544682 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb670795-f534-4f81-a49a-b3c93020eee8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.545988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4e118-b991-4529-aea7-ae5ccf75d831 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:15.551937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 235/448] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Oct 4 08:21:15 2022] GET /identity/v3/role_assignments?group.id=cc106e23fd9748b4a58ec66edc406b83&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=adb2774e1d254454a97fab85c6000155 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:15.552551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4e118-b991-4529-aea7-ae5ccf75d831 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:15.586209 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a88501-2125-4433-9b6c-bc81873ef02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.586884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a88501-2125-4433-9b6c-bc81873ef02d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.587166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a88501-2125-4433-9b6c-bc81873ef02d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.587441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a88501-2125-4433-9b6c-bc81873ef02d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:15.588219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a88501-2125-4433-9b6c-bc81873ef02d None admin] RBAC: Adding query filter params (group.id=cc106e23fd9748b4a58ec66edc406b83, role.id=8bc105194aae4f11b5a2b917bb621f1f, scope.project.id=fdf4e0e74ba94622a91171159045ae6d) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:15.588526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a88501-2125-4433-9b6c-bc81873ef02d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:15.590055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a88501-2125-4433-9b6c-bc81873ef02d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:15.596793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 214/449] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Oct 4 08:21:15 2022] GET /identity/v3/role_assignments?group.id=cc106e23fd9748b4a58ec66edc406b83&scope.project.id=fdf4e0e74ba94622a91171159045ae6d&role.id=8bc105194aae4f11b5a2b917bb621f1f => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:15.597577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a88501-2125-4433-9b6c-bc81873ef02d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:15.622467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:15.708461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4e118-b991-4529-aea7-ae5ccf75d831 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.730820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a88501-2125-4433-9b6c-bc81873ef02d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.769121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8775ee-da36-4939-a3d7-3e875f369f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.770295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8775ee-da36-4939-a3d7-3e875f369f02 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.770740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8775ee-da36-4939-a3d7-3e875f369f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.771297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8775ee-da36-4939-a3d7-3e875f369f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:15.773211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8775ee-da36-4939-a3d7-3e875f369f02 None admin] RBAC: Adding query filter params (group.id=cc106e23fd9748b4a58ec66edc406b83, role.id=8bc105194aae4f11b5a2b917bb621f1f, scope.project.id=6f765e7077fd48a9a2c1f5169c76b008) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:15.773697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8775ee-da36-4939-a3d7-3e875f369f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:15.775690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8775ee-da36-4939-a3d7-3e875f369f02 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:15.777997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c269c5-a3ec-46bb-9733-57c22d4914f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.778700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c269c5-a3ec-46bb-9733-57c22d4914f1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.779981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c269c5-a3ec-46bb-9733-57c22d4914f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.779981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c269c5-a3ec-46bb-9733-57c22d4914f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:15.780528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c269c5-a3ec-46bb-9733-57c22d4914f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:15.780831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c269c5-a3ec-46bb-9733-57c22d4914f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:15.782203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c269c5-a3ec-46bb-9733-57c22d4914f1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:15.784719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:15.784858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 236/450] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Oct 4 08:21:15 2022] GET /identity/v3/role_assignments?group.id=cc106e23fd9748b4a58ec66edc406b83&scope.project.id=6f765e7077fd48a9a2c1f5169c76b008&role.id=8bc105194aae4f11b5a2b917bb621f1f => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:15.792608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 215/451] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:15.799212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8775ee-da36-4939-a3d7-3e875f369f02 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:15.924471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8775ee-da36-4939-a3d7-3e875f369f02 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:15.940146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:15.965690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574a738-7c9d-4562-aa14-4e74fe77fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:15.965690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574a738-7c9d-4562-aa14-4e74fe77fb81 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:15.965968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574a738-7c9d-4562-aa14-4e74fe77fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:15.966226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574a738-7c9d-4562-aa14-4e74fe77fb81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:16.040741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574a738-7c9d-4562-aa14-4e74fe77fb81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:16.042200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574a738-7c9d-4562-aa14-4e74fe77fb81 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:16.143081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 237/452] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:21:16.149453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c269c5-a3ec-46bb-9733-57c22d4914f1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:16.250020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c269c5-a3ec-46bb-9733-57c22d4914f1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:16.285121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876589c7-0760-45b4-8351-f8cbe89ded41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:16.285752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876589c7-0760-45b4-8351-f8cbe89ded41 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:16.286034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876589c7-0760-45b4-8351-f8cbe89ded41 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:16.286307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876589c7-0760-45b4-8351-f8cbe89ded41 None admin] PATH_INFO: `/v3/projects/9e3a02aac0ea474388632672a0c54b89` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:16.287479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876589c7-0760-45b4-8351-f8cbe89ded41 None admin] RBAC: Authorizing `identity:get_project(project_id=9e3a02aac0ea474388632672a0c54b89)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:16.288925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876589c7-0760-45b4-8351-f8cbe89ded41 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:16.290547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 216/453] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:21:16 2022] GET /identity/v3/projects/9e3a02aac0ea474388632672a0c54b89 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:16.296114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574a738-7c9d-4562-aa14-4e74fe77fb81 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:16.311684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:16.397228 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574a738-7c9d-4562-aa14-4e74fe77fb81 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:16.430698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b7a1d-a9e5-4c78-93de-77324af35854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:16.431333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b7a1d-a9e5-4c78-93de-77324af35854 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:16.431608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b7a1d-a9e5-4c78-93de-77324af35854 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:16.431879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b7a1d-a9e5-4c78-93de-77324af35854 None admin] PATH_INFO: `/v3/groups/2f75dfbb819d47b780cd44d51c7500e1` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:16.432974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b7a1d-a9e5-4c78-93de-77324af35854 None admin] RBAC: Authorizing `identity:get_group(group_id=2f75dfbb819d47b780cd44d51c7500e1)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:16.434418 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b7a1d-a9e5-4c78-93de-77324af35854 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:16.436001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 238/454] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Oct 4 08:21:16 2022] GET /identity/v3/groups/2f75dfbb819d47b780cd44d51c7500e1 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:16.442101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876589c7-0760-45b4-8351-f8cbe89ded41 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:16.510215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:16.543682 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876589c7-0760-45b4-8351-f8cbe89ded41 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:16.576355 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d1041-9310-4467-a79a-dbcaf1a9ab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:16.576946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d1041-9310-4467-a79a-dbcaf1a9ab82 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:16.577225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d1041-9310-4467-a79a-dbcaf1a9ab82 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:16.577497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d1041-9310-4467-a79a-dbcaf1a9ab82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:16.578216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d1041-9310-4467-a79a-dbcaf1a9ab82 None admin] RBAC: Adding query filter params (group.id=2f75dfbb819d47b780cd44d51c7500e1, role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=9e3a02aac0ea474388632672a0c54b89) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:16.578524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d1041-9310-4467-a79a-dbcaf1a9ab82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:16.579976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d1041-9310-4467-a79a-dbcaf1a9ab82 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:16.585473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 217/455] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Oct 4 08:21:16 2022] GET /identity/v3/role_assignments?group.id=2f75dfbb819d47b780cd44d51c7500e1&scope.project.id=9e3a02aac0ea474388632672a0c54b89&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:19.083612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffa3cc-5f32-4884-b977-d7d8350bdb66 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:19.084771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffa3cc-5f32-4884-b977-d7d8350bdb66 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:19.084852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffa3cc-5f32-4884-b977-d7d8350bdb66 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:19.086586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 239/456] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:19.092057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc685-65db-4cb0-a249-a28f0349cb10 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:19.092468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc685-65db-4cb0-a249-a28f0349cb10 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:19.092671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc685-65db-4cb0-a249-a28f0349cb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:19.117734 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6a2cc685-65db-4cb0-a249-a28f0349cb10 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:19.119055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6a2cc685-65db-4cb0-a249-a28f0349cb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:19.217609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 218/457] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:21:19.466762 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2400d-d12a-4e6c-a6d8-baef0d54698e None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:19.467071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2400d-d12a-4e6c-a6d8-baef0d54698e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:19.467316 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2400d-d12a-4e6c-a6d8-baef0d54698e None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:19.468993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 240/458] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:19.474723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc5939-cbf4-4d12-914a-fa36f78e2973 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:19.474877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc5939-cbf4-4d12-914a-fa36f78e2973 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:19.475112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc5939-cbf4-4d12-914a-fa36f78e2973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:19.502921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-04fc5939-cbf4-4d12-914a-fa36f78e2973 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:19.504109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-04fc5939-cbf4-4d12-914a-fa36f78e2973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:19.542264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2400d-d12a-4e6c-a6d8-baef0d54698e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:19.592871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:19.605501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 219/459] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:19.606775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80175a2-3ffb-48e7-93d2-bbf70099b22f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:19.607061 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80175a2-3ffb-48e7-93d2-bbf70099b22f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:19.607344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80175a2-3ffb-48e7-93d2-bbf70099b22f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:19.608759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 220/460] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:19.614120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35819d42-a9ca-44db-be8b-45c91bdadd1e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:19.614491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35819d42-a9ca-44db-be8b-45c91bdadd1e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:19.614811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35819d42-a9ca-44db-be8b-45c91bdadd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:19.634203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-35819d42-a9ca-44db-be8b-45c91bdadd1e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:19.635484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-35819d42-a9ca-44db-be8b-45c91bdadd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:19.643539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:19.666078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2400d-d12a-4e6c-a6d8-baef0d54698e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:19.704788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e402-8896-4cb1-ab97-7b4dfd6c0dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:19.705422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e402-8896-4cb1-ab97-7b4dfd6c0dac None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:19.705701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e402-8896-4cb1-ab97-7b4dfd6c0dac None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:19.705976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e402-8896-4cb1-ab97-7b4dfd6c0dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:19.733107 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e402-8896-4cb1-ab97-7b4dfd6c0dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:19.734554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e402-8896-4cb1-ab97-7b4dfd6c0dac None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:19.750748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 221/461] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-6c57e402-8896-4cb1-ab97-7b4dfd6c0dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:19.764982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:19.765938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:19.766843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:19.766843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:19.766843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:19.770697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 241/462] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:19.772488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35819d42-a9ca-44db-be8b-45c91bdadd1e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:19.907738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e402-8896-4cb1-ab97-7b4dfd6c0dac None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:19.955369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35819d42-a9ca-44db-be8b-45c91bdadd1e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:20.005816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:20.047510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129956-953a-4502-aa80-0bf230144109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:20.048147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129956-953a-4502-aa80-0bf230144109 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.048429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129956-953a-4502-aa80-0bf230144109 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.048706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129956-953a-4502-aa80-0bf230144109 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.049369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3129956-953a-4502-aa80-0bf230144109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:20.049674 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3129956-953a-4502-aa80-0bf230144109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:20.051379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3129956-953a-4502-aa80-0bf230144109 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:20.057582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e402-8896-4cb1-ab97-7b4dfd6c0dac None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:20.073141 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 222/463] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:20.073960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129956-953a-4502-aa80-0bf230144109 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:20.098769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:20.106360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86b3d8-ba6a-40d3-bd80-4bdbf07315d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:20.107259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86b3d8-ba6a-40d3-bd80-4bdbf07315d9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.107715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86b3d8-ba6a-40d3-bd80-4bdbf07315d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.108159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86b3d8-ba6a-40d3-bd80-4bdbf07315d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.122254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86b3d8-ba6a-40d3-bd80-4bdbf07315d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:20.124335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86b3d8-ba6a-40d3-bd80-4bdbf07315d9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0e86b3d8-ba6a-40d3-bd80-4bdbf07315d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:20.141596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:20.142528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:20.143427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:20.143427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:20.143427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:20.145508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 242/464] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:20.146378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86b3d8-ba6a-40d3-bd80-4bdbf07315d9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:20.197291 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129956-953a-4502-aa80-0bf230144109 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:20.232224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937361b6-34c9-485b-976d-535c0716649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:20.232855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937361b6-34c9-485b-976d-535c0716649f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.233140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937361b6-34c9-485b-976d-535c0716649f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.233415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937361b6-34c9-485b-976d-535c0716649f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.244482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937361b6-34c9-485b-976d-535c0716649f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:20.245937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937361b6-34c9-485b-976d-535c0716649f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:20.260235 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86b3d8-ba6a-40d3-bd80-4bdbf07315d9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-937361b6-34c9-485b-976d-535c0716649f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:20.260412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:20.261254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:20.262188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:20.262188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:20.262188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:20.262188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 223/465] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:20.263185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937361b6-34c9-485b-976d-535c0716649f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:20.303445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:20.304000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b8293-f41f-44c0-bfdb-91d2749b5496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:20.305072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b8293-f41f-44c0-bfdb-91d2749b5496 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.305459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b8293-f41f-44c0-bfdb-91d2749b5496 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.305779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b8293-f41f-44c0-bfdb-91d2749b5496 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.306481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b8293-f41f-44c0-bfdb-91d2749b5496 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:20.308119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b8293-f41f-44c0-bfdb-91d2749b5496 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:20.329807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 243/466] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:21:20 2022] POST /identity/v3/users => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:21:20.340652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1c6b-fa3e-4931-9037-6c691acc3ea5 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.340974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1c6b-fa3e-4931-9037-6c691acc3ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.341271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1c6b-fa3e-4931-9037-6c691acc3ea5 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.346870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 244/467] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:20.348575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f1c6b-fa3e-4931-9037-6c691acc3ea5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:20.393984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937361b6-34c9-485b-976d-535c0716649f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:20.411775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:20.450030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03213a5f-27cc-405f-89ff-1a679d39ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:20.454358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03213a5f-27cc-405f-89ff-1a679d39ba4d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.454358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03213a5f-27cc-405f-89ff-1a679d39ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.454579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03213a5f-27cc-405f-89ff-1a679d39ba4d None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.455194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03213a5f-27cc-405f-89ff-1a679d39ba4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:20.455511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03213a5f-27cc-405f-89ff-1a679d39ba4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:20.461383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03213a5f-27cc-405f-89ff-1a679d39ba4d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:20.480000 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 224/468] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:20.481659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52301c6-cfa1-48ab-ad17-24c5bcfeb8ca None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.482170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52301c6-cfa1-48ab-ad17-24c5bcfeb8ca None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.482706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52301c6-cfa1-48ab-ad17-24c5bcfeb8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.503841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f1c6b-fa3e-4931-9037-6c691acc3ea5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:20.508952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a52301c6-cfa1-48ab-ad17-24c5bcfeb8ca None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:20.510191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a52301c6-cfa1-48ab-ad17-24c5bcfeb8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:20.549958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d414e7f-dba6-4512-b1b1-a69afdc42fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:20.550604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d414e7f-dba6-4512-b1b1-a69afdc42fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.551163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d414e7f-dba6-4512-b1b1-a69afdc42fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.551437 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d414e7f-dba6-4512-b1b1-a69afdc42fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.552268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d414e7f-dba6-4512-b1b1-a69afdc42fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:20.552636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d414e7f-dba6-4512-b1b1-a69afdc42fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:20.555544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d414e7f-dba6-4512-b1b1-a69afdc42fe9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:20.574735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 245/469] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:20.575702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d414e7f-dba6-4512-b1b1-a69afdc42fe9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:20.600436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 225/470] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:20.601493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52301c6-cfa1-48ab-ad17-24c5bcfeb8ca None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:20.629966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:20.748134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d414e7f-dba6-4512-b1b1-a69afdc42fe9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:20.750735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:20.752376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52301c6-cfa1-48ab-ad17-24c5bcfeb8ca None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:20.819884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52151fd-d09d-4247-80ba-9fc5fdb807fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:20.820926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52151fd-d09d-4247-80ba-9fc5fdb807fa None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.821568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52151fd-d09d-4247-80ba-9fc5fdb807fa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.821843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52151fd-d09d-4247-80ba-9fc5fdb807fa None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.822520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52151fd-d09d-4247-80ba-9fc5fdb807fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:20.824033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52151fd-d09d-4247-80ba-9fc5fdb807fa None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:20.828110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0291b54-f09d-4d45-a6f2-538d6d82ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:20.828744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0291b54-f09d-4d45-a6f2-538d6d82ad2d None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.829024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0291b54-f09d-4d45-a6f2-538d6d82ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.829386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0291b54-f09d-4d45-a6f2-538d6d82ad2d None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.830055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0291b54-f09d-4d45-a6f2-538d6d82ad2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:20.831561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0291b54-f09d-4d45-a6f2-538d6d82ad2d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:20.870223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 246/471] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:21:20 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:21:20.883071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 226/472] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:21:20 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:21:20.949194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52151fd-d09d-4247-80ba-9fc5fdb807fa None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:20.955087 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab21367-0944-4c64-bf49-d167eabcf8eb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.955389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab21367-0944-4c64-bf49-d167eabcf8eb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.955640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab21367-0944-4c64-bf49-d167eabcf8eb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.957326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 227/473] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:20.963455 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840dd99-6116-4b6b-a88f-ce827c2ad8a4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:20.963757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840dd99-6116-4b6b-a88f-ce827c2ad8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:20.964008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840dd99-6116-4b6b-a88f-ce827c2ad8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:20.999930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4840dd99-6116-4b6b-a88f-ce827c2ad8a4 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:21.001281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4840dd99-6116-4b6b-a88f-ce827c2ad8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:21.089665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52151fd-d09d-4247-80ba-9fc5fdb807fa None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:21.134310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85edab-203e-4ccf-b1c0-cfc6268862a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:21.135069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85edab-203e-4ccf-b1c0-cfc6268862a4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:21.135298 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85edab-203e-4ccf-b1c0-cfc6268862a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:21.135537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85edab-203e-4ccf-b1c0-cfc6268862a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:21.143181 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 228/474] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:21:21.149534 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85edab-203e-4ccf-b1c0-cfc6268862a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:21.151070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85edab-203e-4ccf-b1c0-cfc6268862a4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2e85edab-203e-4ccf-b1c0-cfc6268862a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:21.167166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:21.168125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:21.168976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:21.168976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:21.168976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:21.168976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 247/475] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:21.177482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840dd99-6116-4b6b-a88f-ce827c2ad8a4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:21.190964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:21.304769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840dd99-6116-4b6b-a88f-ce827c2ad8a4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:21.362201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e204c3c-761a-4bb1-993b-d74802ca81de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:21.362765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e204c3c-761a-4bb1-993b-d74802ca81de None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:21.363042 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e204c3c-761a-4bb1-993b-d74802ca81de None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:21.363310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e204c3c-761a-4bb1-993b-d74802ca81de None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:21.363951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e204c3c-761a-4bb1-993b-d74802ca81de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:21.364251 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e204c3c-761a-4bb1-993b-d74802ca81de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:21.366191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e204c3c-761a-4bb1-993b-d74802ca81de None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:21.381879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 229/476] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:21.387792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85edab-203e-4ccf-b1c0-cfc6268862a4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:21.409772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:21.421259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e204c3c-761a-4bb1-993b-d74802ca81de None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:21.539592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:21.571950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85edab-203e-4ccf-b1c0-cfc6268862a4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:21.598531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e204c3c-761a-4bb1-993b-d74802ca81de None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:21.648633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f3416-7570-42fa-828a-b05895ed1b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:21.649168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3416-7570-42fa-828a-b05895ed1b6a None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:21.649446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3416-7570-42fa-828a-b05895ed1b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:21.649720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3416-7570-42fa-828a-b05895ed1b6a None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:21.650381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f3416-7570-42fa-828a-b05895ed1b6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:21.651841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f3416-7570-42fa-828a-b05895ed1b6a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:21.654939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befc411-4f17-4189-b96e-024e7efbb756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:21.655556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befc411-4f17-4189-b96e-024e7efbb756 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:21.655838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befc411-4f17-4189-b96e-024e7efbb756 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:21.656167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befc411-4f17-4189-b96e-024e7efbb756 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:21.656852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befc411-4f17-4189-b96e-024e7efbb756 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:21.658227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befc411-4f17-4189-b96e-024e7efbb756 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:21.671223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.sql.core [None req-1befc411-4f17-4189-b96e-024e7efbb756 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:21:21.671223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 08:21:21.671223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [parameters: {'id': '7367d834263a4da895dcbfc5df204737', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 08:21:21.671223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1befc411-4f17-4189-b96e-024e7efbb756 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Oct 04 08:21:21.690265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:21:21.691379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application yield resource Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise self.value Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application session.commit() Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:21:21.692606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:21:21.694243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:21:21.695418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:21:21.696258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [parameters: {'id': '7367d834263a4da895dcbfc5df204737', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:21.697230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 08:21:21.698153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:21.699093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 230/477] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Oct 4 08:21:21 2022] POST /identity/v3/roles => generated 144 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:21.699174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 248/478] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:21:21 2022] POST /identity/v3/users => generated 249 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:21:21.705980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befc411-4f17-4189-b96e-024e7efbb756 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:21.825493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befc411-4f17-4189-b96e-024e7efbb756 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:21.860681 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:21.872363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e07dc-6859-4558-a80b-f2fcd56dc9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:21.873007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e07dc-6859-4558-a80b-f2fcd56dc9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:21.873284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e07dc-6859-4558-a80b-f2fcd56dc9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:21.873556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e07dc-6859-4558-a80b-f2fcd56dc9d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:21.888906 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e07dc-6859-4558-a80b-f2fcd56dc9d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ad1e07dc-6859-4558-a80b-f2fcd56dc9d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:21.894184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:21.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:21.895986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 231/479] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:21:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:21.902589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f3416-7570-42fa-828a-b05895ed1b6a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:22.013173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:22.067370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f3416-7570-42fa-828a-b05895ed1b6a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:22.121478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f73ea-aa32-4b62-b3de-c8efc2c3f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:22.122097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f73ea-aa32-4b62-b3de-c8efc2c3f7be None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:22.122378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f73ea-aa32-4b62-b3de-c8efc2c3f7be None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:22.122652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f73ea-aa32-4b62-b3de-c8efc2c3f7be None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:22.123366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f73ea-aa32-4b62-b3de-c8efc2c3f7be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:22.123674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f73ea-aa32-4b62-b3de-c8efc2c3f7be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:22.125053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f73ea-aa32-4b62-b3de-c8efc2c3f7be None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:22.145931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 249/480] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:23.001742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b759c15-9b08-4ded-9b63-18b3122b1757 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:23.002480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b759c15-9b08-4ded-9b63-18b3122b1757 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:23.002480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b759c15-9b08-4ded-9b63-18b3122b1757 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:23.004012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 232/481] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:23.011915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85dec1-0a08-41e4-9cc9-2fe5cb4f9eaa None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:23.012401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85dec1-0a08-41e4-9cc9-2fe5cb4f9eaa None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:23.012890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85dec1-0a08-41e4-9cc9-2fe5cb4f9eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:23.039047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3d85dec1-0a08-41e4-9cc9-2fe5cb4f9eaa None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:23.040254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3d85dec1-0a08-41e4-9cc9-2fe5cb4f9eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:23.126197 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 250/482] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:23.469248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036732f-1ba9-4a7f-be24-4429aa1830ab None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:23.469535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036732f-1ba9-4a7f-be24-4429aa1830ab None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:23.469813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036732f-1ba9-4a7f-be24-4429aa1830ab None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:23.471433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 233/483] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:23.483136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404fa58-f79d-4f9e-93e0-0c8b35d2295a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:23.483596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404fa58-f79d-4f9e-93e0-0c8b35d2295a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:23.483674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404fa58-f79d-4f9e-93e0-0c8b35d2295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:23.502064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f404fa58-f79d-4f9e-93e0-0c8b35d2295a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:23.507866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f404fa58-f79d-4f9e-93e0-0c8b35d2295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:23.566925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036732f-1ba9-4a7f-be24-4429aa1830ab None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:23.587601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:23.614246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 251/484] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:23.652102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ca36f-5170-426a-a355-89db9807430c None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:23.652400 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ca36f-5170-426a-a355-89db9807430c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:23.652665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ca36f-5170-426a-a355-89db9807430c None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:23.659636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 252/485] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:21:23.665042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd733f0-900a-4190-9b12-be82edd85837 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:23.665324 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd733f0-900a-4190-9b12-be82edd85837 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:23.665600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd733f0-900a-4190-9b12-be82edd85837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:23.694512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8fd733f0-900a-4190-9b12-be82edd85837 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:23.695740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8fd733f0-900a-4190-9b12-be82edd85837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:23.703402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036732f-1ba9-4a7f-be24-4429aa1830ab None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:23.763695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ee962-3e61-4826-8ab0-2f394ca73ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:23.764691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ee962-3e61-4826-8ab0-2f394ca73ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:23.765169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ee962-3e61-4826-8ab0-2f394ca73ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:23.765641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ee962-3e61-4826-8ab0-2f394ca73ea2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:23.793973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ee962-3e61-4826-8ab0-2f394ca73ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-442ee962-3e61-4826-8ab0-2f394ca73ea2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:23.798855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:23.799733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:23.801471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 234/486] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:23.806726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ee962-3e61-4826-8ab0-2f394ca73ea2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:23.807880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 253/487] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:21:23.881167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:23.936677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd733f0-900a-4190-9b12-be82edd85837 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:23.947070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ee962-3e61-4826-8ab0-2f394ca73ea2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.011948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dfd86-1877-4be6-84c9-ee4236dcaac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:24.012602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dfd86-1877-4be6-84c9-ee4236dcaac5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:24.012827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dfd86-1877-4be6-84c9-ee4236dcaac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:24.013070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dfd86-1877-4be6-84c9-ee4236dcaac5 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:24.013782 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dfd86-1877-4be6-84c9-ee4236dcaac5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:24.014029 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dfd86-1877-4be6-84c9-ee4236dcaac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:24.017023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dfd86-1877-4be6-84c9-ee4236dcaac5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:24.031854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 235/488] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:24.038059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dfd86-1877-4be6-84c9-ee4236dcaac5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:24.119892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd733f0-900a-4190-9b12-be82edd85837 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.151994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:24.169419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dfd86-1877-4be6-84c9-ee4236dcaac5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.173749 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c098-9274-4f9d-b9ea-bbf83701dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:24.174376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c098-9274-4f9d-b9ea-bbf83701dac9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:24.174656 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c098-9274-4f9d-b9ea-bbf83701dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:24.174957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c098-9274-4f9d-b9ea-bbf83701dac9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:24.185212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:24.187990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034c098-9274-4f9d-b9ea-bbf83701dac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-e034c098-9274-4f9d-b9ea-bbf83701dac9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:24.194576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:24.195622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:24.196429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:24.198751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 254/489] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:24.199722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c098-9274-4f9d-b9ea-bbf83701dac9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:24.213379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8ce77-bb71-47e3-8d88-3ea2af722276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:24.214320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8ce77-bb71-47e3-8d88-3ea2af722276 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:24.214818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8ce77-bb71-47e3-8d88-3ea2af722276 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:24.215539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8ce77-bb71-47e3-8d88-3ea2af722276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:24.227202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8ce77-bb71-47e3-8d88-3ea2af722276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:24.229080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8ce77-bb71-47e3-8d88-3ea2af722276 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a2e8ce77-bb71-47e3-8d88-3ea2af722276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:24.244544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:24.245456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:24.246316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:24.246316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:24.246316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:24.248571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 236/490] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:24.249729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8ce77-bb71-47e3-8d88-3ea2af722276 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:24.315013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c098-9274-4f9d-b9ea-bbf83701dac9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.358095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50737a61-3036-4cc2-b150-c2e08d7cab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:24.358756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50737a61-3036-4cc2-b150-c2e08d7cab26 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:24.359043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50737a61-3036-4cc2-b150-c2e08d7cab26 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:24.359317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50737a61-3036-4cc2-b150-c2e08d7cab26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:24.359643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8ce77-bb71-47e3-8d88-3ea2af722276 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.376982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50737a61-3036-4cc2-b150-c2e08d7cab26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-50737a61-3036-4cc2-b150-c2e08d7cab26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:24.384281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:24.385162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:24.385969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:24.390411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 255/491] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:24.391458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50737a61-3036-4cc2-b150-c2e08d7cab26 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:24.405251 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9d7d8-6f76-4621-bb71-1d89c39a3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:24.406200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9d7d8-6f76-4621-bb71-1d89c39a3618 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:24.406809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9d7d8-6f76-4621-bb71-1d89c39a3618 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:24.407255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9d7d8-6f76-4621-bb71-1d89c39a3618 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:24.408186 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9d7d8-6f76-4621-bb71-1d89c39a3618 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:24.408691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9d7d8-6f76-4621-bb71-1d89c39a3618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:24.410261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9d7d8-6f76-4621-bb71-1d89c39a3618 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:24.420081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 237/492] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:24.421104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9d7d8-6f76-4621-bb71-1d89c39a3618 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:24.438241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:24.472256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:24.525321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50737a61-3036-4cc2-b150-c2e08d7cab26 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.563569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7f17-015a-4907-8bca-e12a4f5ec14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:24.564651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7f17-015a-4907-8bca-e12a4f5ec14a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:24.565274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7f17-015a-4907-8bca-e12a4f5ec14a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:24.565786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7f17-015a-4907-8bca-e12a4f5ec14a None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:24.566620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7f17-015a-4907-8bca-e12a4f5ec14a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:24.567156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7f17-015a-4907-8bca-e12a4f5ec14a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:24.567781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9d7d8-6f76-4621-bb71-1d89c39a3618 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.568975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7f17-015a-4907-8bca-e12a4f5ec14a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:24.581673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 256/493] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:24.582758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7f17-015a-4907-8bca-e12a4f5ec14a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:24.611742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712738e-780c-41e6-8475-77d18ff2231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:24.612636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712738e-780c-41e6-8475-77d18ff2231a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:24.612925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712738e-780c-41e6-8475-77d18ff2231a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:24.613208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712738e-780c-41e6-8475-77d18ff2231a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:24.614170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712738e-780c-41e6-8475-77d18ff2231a None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:24.614606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712738e-780c-41e6-8475-77d18ff2231a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:24.616494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712738e-780c-41e6-8475-77d18ff2231a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:24.630762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 238/494] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:24.632022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712738e-780c-41e6-8475-77d18ff2231a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:24.716077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:24.722286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7f17-015a-4907-8bca-e12a4f5ec14a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.738324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:24.759712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712738e-780c-41e6-8475-77d18ff2231a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.772661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413c4f8-066d-495a-8e83-21e3c211b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:24.773528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413c4f8-066d-495a-8e83-21e3c211b51c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:24.773907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413c4f8-066d-495a-8e83-21e3c211b51c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:24.774285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413c4f8-066d-495a-8e83-21e3c211b51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:24.790193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413c4f8-066d-495a-8e83-21e3c211b51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:24.791993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413c4f8-066d-495a-8e83-21e3c211b51c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-8413c4f8-066d-495a-8e83-21e3c211b51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:24.810551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:24.812302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:24.813942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:24.813942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:24.813942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:24.822799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 257/495] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:24.822799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413c4f8-066d-495a-8e83-21e3c211b51c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:24.841403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83751c60-f06c-443a-ab1f-2cb766bb3e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:24.842903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751c60-f06c-443a-ab1f-2cb766bb3e68 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:24.843339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751c60-f06c-443a-ab1f-2cb766bb3e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:24.844068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751c60-f06c-443a-ab1f-2cb766bb3e68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:24.856444 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83751c60-f06c-443a-ab1f-2cb766bb3e68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:24.858051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83751c60-f06c-443a-ab1f-2cb766bb3e68 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-83751c60-f06c-443a-ab1f-2cb766bb3e68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:24.871137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:24.872286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:24.873425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:24.873425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:24.873425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:24.873425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:24.873425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:24.873425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:24.873425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:24.873425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:24.873425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:24.873425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:24.875288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 239/496] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Oct 4 08:21:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:24.876249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83751c60-f06c-443a-ab1f-2cb766bb3e68 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:24.942360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413c4f8-066d-495a-8e83-21e3c211b51c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.975265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef638e2-a46b-48b1-b34a-d9da094fd469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:24.975880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef638e2-a46b-48b1-b34a-d9da094fd469 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:24.975982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83751c60-f06c-443a-ab1f-2cb766bb3e68 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:24.976157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef638e2-a46b-48b1-b34a-d9da094fd469 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:24.976428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef638e2-a46b-48b1-b34a-d9da094fd469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:24.986980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef638e2-a46b-48b1-b34a-d9da094fd469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:24.988431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef638e2-a46b-48b1-b34a-d9da094fd469 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:24.996643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-4ef638e2-a46b-48b1-b34a-d9da094fd469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:25.003199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:25.004262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:25.005219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:25.005219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:25.005219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:25.007747 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 258/497] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:25.008547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef638e2-a46b-48b1-b34a-d9da094fd469 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:25.009193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29090ec6-ca67-4f59-9a11-ef9890b5f378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:25.009798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090ec6-ca67-4f59-9a11-ef9890b5f378 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.010075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090ec6-ca67-4f59-9a11-ef9890b5f378 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.010343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090ec6-ca67-4f59-9a11-ef9890b5f378 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.011084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29090ec6-ca67-4f59-9a11-ef9890b5f378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:25.011389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29090ec6-ca67-4f59-9a11-ef9890b5f378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:25.012912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29090ec6-ca67-4f59-9a11-ef9890b5f378 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:25.025037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 240/498] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:25.026276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607a7e-ed44-4887-8c9b-071f3654eaef None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.026558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607a7e-ed44-4887-8c9b-071f3654eaef None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.026854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607a7e-ed44-4887-8c9b-071f3654eaef None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.028019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 241/499] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:25.029004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498c007-c2fb-4823-9ec5-6642ac6bbd20 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.029483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498c007-c2fb-4823-9ec5-6642ac6bbd20 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.029695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498c007-c2fb-4823-9ec5-6642ac6bbd20 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.033788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 242/500] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:25.033788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498c007-c2fb-4823-9ec5-6642ac6bbd20 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:25.043874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:25.113813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef638e2-a46b-48b1-b34a-d9da094fd469 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:25.133334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498c007-c2fb-4823-9ec5-6642ac6bbd20 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:25.149211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c1989-109f-4570-ada9-83a9b671dc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:25.149817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c1989-109f-4570-ada9-83a9b671dc13 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.152180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c1989-109f-4570-ada9-83a9b671dc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.152180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c1989-109f-4570-ada9-83a9b671dc13 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.152180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c1989-109f-4570-ada9-83a9b671dc13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:25.152180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c1989-109f-4570-ada9-83a9b671dc13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:25.152818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c1989-109f-4570-ada9-83a9b671dc13 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:25.172564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684fc7-ec6e-43d7-b40e-d913094682cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:25.173170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684fc7-ec6e-43d7-b40e-d913094682cc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.173452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684fc7-ec6e-43d7-b40e-d913094682cc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.173725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684fc7-ec6e-43d7-b40e-d913094682cc None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.174366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21684fc7-ec6e-43d7-b40e-d913094682cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:25.174690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21684fc7-ec6e-43d7-b40e-d913094682cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:25.176323 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21684fc7-ec6e-43d7-b40e-d913094682cc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:25.187564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 243/501] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:25.188456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684fc7-ec6e-43d7-b40e-d913094682cc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:25.191654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 259/502] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Oct 4 08:21:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:25.192761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e849b27-86e1-4407-b965-a1441a0d20bf None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.193704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e849b27-86e1-4407-b965-a1441a0d20bf None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.193985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e849b27-86e1-4407-b965-a1441a0d20bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.211573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3e849b27-86e1-4407-b965-a1441a0d20bf None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:25.212750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3e849b27-86e1-4407-b965-a1441a0d20bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:25.258447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:25.264216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:25.277875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 260/503] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:25.279178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b64ce7-f772-4c13-8c00-80a3af312fcb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.279466 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b64ce7-f772-4c13-8c00-80a3af312fcb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.279740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b64ce7-f772-4c13-8c00-80a3af312fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.290432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684fc7-ec6e-43d7-b40e-d913094682cc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:25.299304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b2b64ce7-f772-4c13-8c00-80a3af312fcb None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:25.300612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b2b64ce7-f772-4c13-8c00-80a3af312fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:25.325866 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a5ee2-e8b2-459c-861f-911475170fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:25.326875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5ee2-e8b2-459c-861f-911475170fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.327309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5ee2-e8b2-459c-861f-911475170fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.327589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5ee2-e8b2-459c-861f-911475170fa1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.335173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a5ee2-e8b2-459c-861f-911475170fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:25.336619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a5ee2-e8b2-459c-861f-911475170fa1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-856a5ee2-e8b2-459c-861f-911475170fa1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:25.347719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:25.348609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 244/504] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:25.350522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a5ee2-e8b2-459c-861f-911475170fa1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:25.376311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 261/505] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:25.377505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b64ce7-f772-4c13-8c00-80a3af312fcb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:25.483418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a5ee2-e8b2-459c-861f-911475170fa1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:25.485067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b64ce7-f772-4c13-8c00-80a3af312fcb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:25.504155 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:25.516705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:25.523977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f7720-f0ac-4172-90c5-fad6e9ccc167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:25.524722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c215f-4376-4841-83eb-dc3313858ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:25.525120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f7720-f0ac-4172-90c5-fad6e9ccc167 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.525353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c215f-4376-4841-83eb-dc3313858ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.525773 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c215f-4376-4841-83eb-dc3313858ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.525935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c215f-4376-4841-83eb-dc3313858ad9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.526372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f7720-f0ac-4172-90c5-fad6e9ccc167 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.526875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f7720-f0ac-4172-90c5-fad6e9ccc167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.533460 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c215f-4376-4841-83eb-dc3313858ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:25.535173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c215f-4376-4841-83eb-dc3313858ad9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-fd4c215f-4376-4841-83eb-dc3313858ad9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:25.550208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:25.551449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 262/506] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:25.557794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c215f-4376-4841-83eb-dc3313858ad9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:25.604110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f7720-f0ac-4172-90c5-fad6e9ccc167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:25.605600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f7720-f0ac-4172-90c5-fad6e9ccc167 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:25.660511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c215f-4376-4841-83eb-dc3313858ad9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:25.694241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719bf63-a854-44ea-aba5-cb645e8ee1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:25.694873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719bf63-a854-44ea-aba5-cb645e8ee1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.695160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719bf63-a854-44ea-aba5-cb645e8ee1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.695432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719bf63-a854-44ea-aba5-cb645e8ee1f1 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.696158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719bf63-a854-44ea-aba5-cb645e8ee1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:25.696462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719bf63-a854-44ea-aba5-cb645e8ee1f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:25.697899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719bf63-a854-44ea-aba5-cb645e8ee1f1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:25.704894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 245/507] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:25.705745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f7720-f0ac-4172-90c5-fad6e9ccc167 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:25.715858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 263/508] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Oct 4 08:21:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:25.716756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719bf63-a854-44ea-aba5-cb645e8ee1f1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:25.738390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:25.754184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:25.807897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f7720-f0ac-4172-90c5-fad6e9ccc167 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:25.819580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719bf63-a854-44ea-aba5-cb645e8ee1f1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:25.839968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b73ba2-7b98-4343-8ac0-c54f9dc9c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:25.840584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b73ba2-7b98-4343-8ac0-c54f9dc9c891 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.840861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b73ba2-7b98-4343-8ac0-c54f9dc9c891 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.841128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b73ba2-7b98-4343-8ac0-c54f9dc9c891 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.851292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b73ba2-7b98-4343-8ac0-c54f9dc9c891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:25.852867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e9a12-d0d5-4bcf-b831-7a974ba13051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:25.853468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9a12-d0d5-4bcf-b831-7a974ba13051 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.853745 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9a12-d0d5-4bcf-b831-7a974ba13051 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.854016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9a12-d0d5-4bcf-b831-7a974ba13051 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:25.854764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e9a12-d0d5-4bcf-b831-7a974ba13051 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:25.855074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e9a12-d0d5-4bcf-b831-7a974ba13051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-85b73ba2-7b98-4343-8ac0-c54f9dc9c891 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:25.856002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:25.857004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:25.857845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:25.858449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e9a12-d0d5-4bcf-b831-7a974ba13051 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:25.858519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 246/509] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:25.858519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b73ba2-7b98-4343-8ac0-c54f9dc9c891 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:25.877234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 264/510] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Oct 4 08:21:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:25.878051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e9a12-d0d5-4bcf-b831-7a974ba13051 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:25.948462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:25.958207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b73ba2-7b98-4343-8ac0-c54f9dc9c891 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:25.968736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:25.976729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e9a12-d0d5-4bcf-b831-7a974ba13051 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:25.992660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8079132-1910-4769-a88e-710ca69a6e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:25.993274 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079132-1910-4769-a88e-710ca69a6e81 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:25.993549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079132-1910-4769-a88e-710ca69a6e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:25.993818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079132-1910-4769-a88e-710ca69a6e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:26.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8079132-1910-4769-a88e-710ca69a6e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:26.004776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8079132-1910-4769-a88e-710ca69a6e81 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:26.012942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035ddb1-8eb0-47b3-8a0e-7e02f032c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:26.013580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035ddb1-8eb0-47b3-8a0e-7e02f032c1fa None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:26.013860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035ddb1-8eb0-47b3-8a0e-7e02f032c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:26.014130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035ddb1-8eb0-47b3-8a0e-7e02f032c1fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e8079132-1910-4769-a88e-710ca69a6e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:26.018796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:26.020006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:26.020890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:26.020890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:26.020890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:26.020890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 247/511] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:26.021178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8079132-1910-4769-a88e-710ca69a6e81 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:26.025697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035ddb1-8eb0-47b3-8a0e-7e02f032c1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:26.027205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035ddb1-8eb0-47b3-8a0e-7e02f032c1fa None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-3035ddb1-8eb0-47b3-8a0e-7e02f032c1fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:26.042034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:26.042982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:26.043824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:26.043824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:26.043824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:26.043824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 265/512] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:26.044060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035ddb1-8eb0-47b3-8a0e-7e02f032c1fa None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:26.124095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8079132-1910-4769-a88e-710ca69a6e81 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:26.144564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035ddb1-8eb0-47b3-8a0e-7e02f032c1fa None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:26.156824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b22a8f-143b-48d9-9716-47eb28f6868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:26.157427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b22a8f-143b-48d9-9716-47eb28f6868a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:26.157704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b22a8f-143b-48d9-9716-47eb28f6868a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:26.157982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b22a8f-143b-48d9-9716-47eb28f6868a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:26.170069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:26.178791 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3201fa-e340-4c9f-8170-829b6ec260a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:26.179387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3201fa-e340-4c9f-8170-829b6ec260a3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:26.179662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3201fa-e340-4c9f-8170-829b6ec260a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:26.179937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3201fa-e340-4c9f-8170-829b6ec260a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:26.180601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3201fa-e340-4c9f-8170-829b6ec260a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:26.180903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3201fa-e340-4c9f-8170-829b6ec260a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:26.182268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3201fa-e340-4c9f-8170-829b6ec260a3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:26.189915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 266/513] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:26.190951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3201fa-e340-4c9f-8170-829b6ec260a3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:26.203244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:26.234302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b22a8f-143b-48d9-9716-47eb28f6868a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:26.235910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b22a8f-143b-48d9-9716-47eb28f6868a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:26.292179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3201fa-e340-4c9f-8170-829b6ec260a3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:26.324377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71007d-845e-456e-b57f-516de36fcf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:26.324982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71007d-845e-456e-b57f-516de36fcf56 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:26.325257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71007d-845e-456e-b57f-516de36fcf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:26.325530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71007d-845e-456e-b57f-516de36fcf56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:26.334238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 248/514] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:26.335171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b22a8f-143b-48d9-9716-47eb28f6868a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:26.378048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:26.395637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71007d-845e-456e-b57f-516de36fcf56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:26.397433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71007d-845e-456e-b57f-516de36fcf56 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:26.406738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:26.433030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b22a8f-143b-48d9-9716-47eb28f6868a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:26.467797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba8307-c74b-49cd-91d9-6a7768dd6919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:26.468330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba8307-c74b-49cd-91d9-6a7768dd6919 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:26.468690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba8307-c74b-49cd-91d9-6a7768dd6919 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:26.468863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba8307-c74b-49cd-91d9-6a7768dd6919 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:26.469502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba8307-c74b-49cd-91d9-6a7768dd6919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:26.469807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba8307-c74b-49cd-91d9-6a7768dd6919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:26.471230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba8307-c74b-49cd-91d9-6a7768dd6919 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:26.482963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 249/515] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:26.483779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba8307-c74b-49cd-91d9-6a7768dd6919 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:26.505124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 267/516] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:26.506335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71007d-845e-456e-b57f-516de36fcf56 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:26.596558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba8307-c74b-49cd-91d9-6a7768dd6919 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:26.598210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:26.620742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71007d-845e-456e-b57f-516de36fcf56 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:26.630004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:26.638537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25196623-cc6a-4ebc-899a-f852015c8b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:26.639169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25196623-cc6a-4ebc-899a-f852015c8b7a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:26.639441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25196623-cc6a-4ebc-899a-f852015c8b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:26.639711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25196623-cc6a-4ebc-899a-f852015c8b7a None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:26.640399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25196623-cc6a-4ebc-899a-f852015c8b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:26.640705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25196623-cc6a-4ebc-899a-f852015c8b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:26.642080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25196623-cc6a-4ebc-899a-f852015c8b7a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:26.654765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 250/517] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:26.659954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25196623-cc6a-4ebc-899a-f852015c8b7a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:26.666053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9274018-2a5f-4187-96a4-7f22d16a18e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:26.666719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274018-2a5f-4187-96a4-7f22d16a18e9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:26.667003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274018-2a5f-4187-96a4-7f22d16a18e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:26.667274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274018-2a5f-4187-96a4-7f22d16a18e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:26.678083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9274018-2a5f-4187-96a4-7f22d16a18e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:26.679554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9274018-2a5f-4187-96a4-7f22d16a18e9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-e9274018-2a5f-4187-96a4-7f22d16a18e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:26.695133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:26.696277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:26.698040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:26.698040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:26.698040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:26.698040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 268/518] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:26.698040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9274018-2a5f-4187-96a4-7f22d16a18e9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:26.780187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25196623-cc6a-4ebc-899a-f852015c8b7a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:26.810439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9274018-2a5f-4187-96a4-7f22d16a18e9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:26.817088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58534c-3a55-4557-9e61-360ee493b89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:26.817718 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58534c-3a55-4557-9e61-360ee493b89f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:26.818066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58534c-3a55-4557-9e61-360ee493b89f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:26.818338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58534c-3a55-4557-9e61-360ee493b89f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:26.828082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58534c-3a55-4557-9e61-360ee493b89f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:26.829529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58534c-3a55-4557-9e61-360ee493b89f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-df58534c-3a55-4557-9e61-360ee493b89f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:26.845145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:26.846109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:26.847015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:26.847015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:26.847015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:26.847184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fa749-f87b-4d04-999b-ce43720d7fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:26.847184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fa749-f87b-4d04-999b-ce43720d7fdc None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:26.847184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fa749-f87b-4d04-999b-ce43720d7fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:26.847388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 251/519] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:26.847455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fa749-f87b-4d04-999b-ce43720d7fdc None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:26.847530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58534c-3a55-4557-9e61-360ee493b89f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:26.847598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fa749-f87b-4d04-999b-ce43720d7fdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:26.848686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fa749-f87b-4d04-999b-ce43720d7fdc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:26.867629 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:26.869906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 269/520] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:21:26 2022] POST /identity/v3/users => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:21:26.870754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fa749-f87b-4d04-999b-ce43720d7fdc None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:26.890460 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:26.977449 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58534c-3a55-4557-9e61-360ee493b89f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:26.991248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fa749-f87b-4d04-999b-ce43720d7fdc None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.014556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b1010-87f3-472f-baf8-11e891da2639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.015240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1010-87f3-472f-baf8-11e891da2639 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.015520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1010-87f3-472f-baf8-11e891da2639 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.015796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1010-87f3-472f-baf8-11e891da2639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.028348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b1010-87f3-472f-baf8-11e891da2639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.029856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b1010-87f3-472f-baf8-11e891da2639 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.032413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89209c-df05-4d70-92ba-b29ebb46017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.033165 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89209c-df05-4d70-92ba-b29ebb46017c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.033611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89209c-df05-4d70-92ba-b29ebb46017c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.033939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89209c-df05-4d70-92ba-b29ebb46017c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.042861 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89209c-df05-4d70-92ba-b29ebb46017c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.044526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89209c-df05-4d70-92ba-b29ebb46017c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a72b1010-87f3-472f-baf8-11e891da2639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:27.046390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:27.047495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:27.049249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:27.049249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:27.049249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:27.049249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 252/521] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:27.049249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b1010-87f3-472f-baf8-11e891da2639 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-ac89209c-df05-4d70-92ba-b29ebb46017c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:27.064695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:27.065611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:27.066720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:27.066720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:27.066720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:27.066720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:27.066720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:27.066720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:27.066720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:27.066720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:27.066720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 270/522] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:27.067384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89209c-df05-4d70-92ba-b29ebb46017c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.134425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:27.164654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:27.172595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b1010-87f3-472f-baf8-11e891da2639 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.192339 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89209c-df05-4d70-92ba-b29ebb46017c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.209796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd8c50-4b19-4121-9754-bc21578b7b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.210421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd8c50-4b19-4121-9754-bc21578b7b5b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.210731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd8c50-4b19-4121-9754-bc21578b7b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.211007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd8c50-4b19-4121-9754-bc21578b7b5b None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.211651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd8c50-4b19-4121-9754-bc21578b7b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:27.211957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd8c50-4b19-4121-9754-bc21578b7b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.213342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd8c50-4b19-4121-9754-bc21578b7b5b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.226172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 253/523] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:27.227033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd8c50-4b19-4121-9754-bc21578b7b5b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.233598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f843-5703-4716-ab90-8f13e633a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.234207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f843-5703-4716-ab90-8f13e633a7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.234492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f843-5703-4716-ab90-8f13e633a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.234789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f843-5703-4716-ab90-8f13e633a7d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.235433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f843-5703-4716-ab90-8f13e633a7d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:27.235978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f843-5703-4716-ab90-8f13e633a7d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.237126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f843-5703-4716-ab90-8f13e633a7d2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.254722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 271/524] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:27.254722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f843-5703-4716-ab90-8f13e633a7d2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.342725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd8c50-4b19-4121-9754-bc21578b7b5b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.358351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f843-5703-4716-ab90-8f13e633a7d2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.370356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:27.379858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cc56e-b8ea-4135-842f-f35ece82c2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.381209 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cc56e-b8ea-4135-842f-f35ece82c2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.381604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cc56e-b8ea-4135-842f-f35ece82c2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.381976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cc56e-b8ea-4135-842f-f35ece82c2d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.382750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cc56e-b8ea-4135-842f-f35ece82c2d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:27.383160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cc56e-b8ea-4135-842f-f35ece82c2d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.384653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cc56e-b8ea-4135-842f-f35ece82c2d0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.395288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a476e1-c2de-4dd1-813c-392f21e1c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.396182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a476e1-c2de-4dd1-813c-392f21e1c937 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.401021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 254/525] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:27.401175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a476e1-c2de-4dd1-813c-392f21e1c937 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.401282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cc56e-b8ea-4135-842f-f35ece82c2d0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.401370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a476e1-c2de-4dd1-813c-392f21e1c937 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.401370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a476e1-c2de-4dd1-813c-392f21e1c937 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:27.401370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a476e1-c2de-4dd1-813c-392f21e1c937 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.401370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a476e1-c2de-4dd1-813c-392f21e1c937 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.404734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:27.421551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 272/526] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:27.422851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a476e1-c2de-4dd1-813c-392f21e1c937 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.521706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cc56e-b8ea-4135-842f-f35ece82c2d0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.548499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a476e1-c2de-4dd1-813c-392f21e1c937 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.557935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2225a4d-1fe1-4d12-8a2d-434f6e9cb2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.558569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2225a4d-1fe1-4d12-8a2d-434f6e9cb2cf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.558882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2225a4d-1fe1-4d12-8a2d-434f6e9cb2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.559154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2225a4d-1fe1-4d12-8a2d-434f6e9cb2cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.566849 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2225a4d-1fe1-4d12-8a2d-434f6e9cb2cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.568318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2225a4d-1fe1-4d12-8a2d-434f6e9cb2cf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b2225a4d-1fe1-4d12-8a2d-434f6e9cb2cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:27.579433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:27.580339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 255/527] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:27.581304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2225a4d-1fe1-4d12-8a2d-434f6e9cb2cf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.590129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e5a7c-64dd-406c-922d-e6544e27f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.591023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5a7c-64dd-406c-922d-e6544e27f88c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.591477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5a7c-64dd-406c-922d-e6544e27f88c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.591919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5a7c-64dd-406c-922d-e6544e27f88c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.599843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e5a7c-64dd-406c-922d-e6544e27f88c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.601422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e5a7c-64dd-406c-922d-e6544e27f88c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b75e5a7c-64dd-406c-922d-e6544e27f88c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:27.612493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:27.613335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:27.614185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:27.614185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:27.614185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:27.614185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:27.614185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:27.614185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:27.614185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:27.614185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:27.614185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 273/528] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:27.615333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e5a7c-64dd-406c-922d-e6544e27f88c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.636643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:27.680584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:27.693094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2225a4d-1fe1-4d12-8a2d-434f6e9cb2cf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.727920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e5a7c-64dd-406c-922d-e6544e27f88c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.730729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ec6c-ed6d-4cd1-ade8-a1bf54300ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.731405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ec6c-ed6d-4cd1-ade8-a1bf54300ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.731657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ec6c-ed6d-4cd1-ade8-a1bf54300ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.731929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ec6c-ed6d-4cd1-ade8-a1bf54300ec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.738853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5ec6c-ed6d-4cd1-ade8-a1bf54300ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.740752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5ec6c-ed6d-4cd1-ade8-a1bf54300ec0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e2e5ec6c-ed6d-4cd1-ade8-a1bf54300ec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:27.753446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:27.754565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:27.755743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:27.755743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:27.755743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:27.755743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:27.755743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:27.755743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:27.755743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:27.755743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:27.755743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 256/529] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:27.755743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ec6c-ed6d-4cd1-ade8-a1bf54300ec0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.770588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a2d9c-3132-48cc-b82c-f821032f6472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.771931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a2d9c-3132-48cc-b82c-f821032f6472 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.772603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a2d9c-3132-48cc-b82c-f821032f6472 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.772950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a2d9c-3132-48cc-b82c-f821032f6472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.774198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a2d9c-3132-48cc-b82c-f821032f6472 None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=2c6603b106fa4db58f3d1b5099606ffa) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:27.774870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a2d9c-3132-48cc-b82c-f821032f6472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.776398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a2d9c-3132-48cc-b82c-f821032f6472 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.790787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 274/530] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/role_assignments?user.id=2c6603b106fa4db58f3d1b5099606ffa&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:27.790787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a2d9c-3132-48cc-b82c-f821032f6472 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.879637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ec6c-ed6d-4cd1-ade8-a1bf54300ec0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.889173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:27.926698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a2d9c-3132-48cc-b82c-f821032f6472 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:27.927028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4572ba-55e9-456f-afa2-66105c698a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.927685 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4572ba-55e9-456f-afa2-66105c698a06 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.927966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4572ba-55e9-456f-afa2-66105c698a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.928238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4572ba-55e9-456f-afa2-66105c698a06 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.928989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4572ba-55e9-456f-afa2-66105c698a06 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:27.929534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4572ba-55e9-456f-afa2-66105c698a06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.934243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4572ba-55e9-456f-afa2-66105c698a06 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.952623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:27.970899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9b29-32f9-45e3-9776-208ba8269e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:27.971740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9b29-32f9-45e3-9776-208ba8269e87 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:27.972176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9b29-32f9-45e3-9776-208ba8269e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:27.972448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9b29-32f9-45e3-9776-208ba8269e87 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:27.973145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9b29-32f9-45e3-9776-208ba8269e87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:27.973454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9b29-32f9-45e3-9776-208ba8269e87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:27.975133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9b29-32f9-45e3-9776-208ba8269e87 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:27.981649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 257/531] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:27.982831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4572ba-55e9-456f-afa2-66105c698a06 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:27.995218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 275/532] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:27.996151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9b29-32f9-45e3-9776-208ba8269e87 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:28.100836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4572ba-55e9-456f-afa2-66105c698a06 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:28.116909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9b29-32f9-45e3-9776-208ba8269e87 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:28.145211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc0b24-8b86-492e-aecc-ba726f040e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:28.145749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc0b24-8b86-492e-aecc-ba726f040e5f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:28.146580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc0b24-8b86-492e-aecc-ba726f040e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:28.146881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc0b24-8b86-492e-aecc-ba726f040e5f None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:28.147577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc0b24-8b86-492e-aecc-ba726f040e5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:28.148061 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc0b24-8b86-492e-aecc-ba726f040e5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:28.149758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc0b24-8b86-492e-aecc-ba726f040e5f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:28.161402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc672ab3-bc6f-4c7c-950f-56322c0ecc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:28.162749 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc672ab3-bc6f-4c7c-950f-56322c0ecc99 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:28.163227 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc672ab3-bc6f-4c7c-950f-56322c0ecc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:28.163731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc672ab3-bc6f-4c7c-950f-56322c0ecc99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:28.170962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 258/533] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:28.171816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc0b24-8b86-492e-aecc-ba726f040e5f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:28.203726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:28.220023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:28.244760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc672ab3-bc6f-4c7c-950f-56322c0ecc99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:28.246535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc672ab3-bc6f-4c7c-950f-56322c0ecc99 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:28.298448 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc0b24-8b86-492e-aecc-ba726f040e5f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:28.341592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6aa1a-15a1-46eb-8ad9-17f5e47ff184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:28.342194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6aa1a-15a1-46eb-8ad9-17f5e47ff184 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:28.342471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6aa1a-15a1-46eb-8ad9-17f5e47ff184 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:28.342764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6aa1a-15a1-46eb-8ad9-17f5e47ff184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:28.343908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6aa1a-15a1-46eb-8ad9-17f5e47ff184 None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=7b2324f9166d4c2dac76f08b03991769) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:28.344220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6aa1a-15a1-46eb-8ad9-17f5e47ff184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:28.345922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6aa1a-15a1-46eb-8ad9-17f5e47ff184 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:28.353209 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 259/534] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:28 2022] GET /identity/v3/role_assignments?user.id=7b2324f9166d4c2dac76f08b03991769&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:28.354089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6aa1a-15a1-46eb-8ad9-17f5e47ff184 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:28.357888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 276/535] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:28.364044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc672ab3-bc6f-4c7c-950f-56322c0ecc99 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:28.508591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:28.530519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6aa1a-15a1-46eb-8ad9-17f5e47ff184 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:28.551209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:28.588385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc672ab3-bc6f-4c7c-950f-56322c0ecc99 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:28.596804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d0dd-7f96-4249-b24d-2a278142b6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:28.597416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d0dd-7f96-4249-b24d-2a278142b6ce None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:28.597737 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d0dd-7f96-4249-b24d-2a278142b6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:28.598022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d0dd-7f96-4249-b24d-2a278142b6ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:28.599671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835d0dd-7f96-4249-b24d-2a278142b6ce None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=53db39d8c5d1459294b0376d052a9495) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:28.599671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835d0dd-7f96-4249-b24d-2a278142b6ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:28.601131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835d0dd-7f96-4249-b24d-2a278142b6ce None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:28.607291 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 260/536] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:28 2022] GET /identity/v3/role_assignments?user.id=53db39d8c5d1459294b0376d052a9495&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:28.637150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb892448-9e55-46cd-a254-3225ad192b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:28.638329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892448-9e55-46cd-a254-3225ad192b70 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:28.639633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892448-9e55-46cd-a254-3225ad192b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:28.640120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892448-9e55-46cd-a254-3225ad192b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:28.652456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb892448-9e55-46cd-a254-3225ad192b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:28.654438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb892448-9e55-46cd-a254-3225ad192b70 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-fb892448-9e55-46cd-a254-3225ad192b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:28.672434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:28.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:28.674309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:28.674309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:28.674309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:28.676666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 277/537] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:28.681899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d0dd-7f96-4249-b24d-2a278142b6ce None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:28.804427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d0dd-7f96-4249-b24d-2a278142b6ce None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:28.846939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa6e55-bc94-40ca-ad79-6564b75f42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:28.847911 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa6e55-bc94-40ca-ad79-6564b75f42db None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:28.848386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa6e55-bc94-40ca-ad79-6564b75f42db None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:28.848850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa6e55-bc94-40ca-ad79-6564b75f42db None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:28.850009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa6e55-bc94-40ca-ad79-6564b75f42db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:28.850655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa6e55-bc94-40ca-ad79-6564b75f42db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:28.853026 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa6e55-bc94-40ca-ad79-6564b75f42db None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:28.873823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 261/538] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:28.879312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb892448-9e55-46cd-a254-3225ad192b70 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:29.001371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb892448-9e55-46cd-a254-3225ad192b70 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:29.041863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:29.047173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bf33f-3d0a-4040-8aea-1be9a090d74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:29.047726 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bf33f-3d0a-4040-8aea-1be9a090d74a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:29.048003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bf33f-3d0a-4040-8aea-1be9a090d74a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:29.048550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bf33f-3d0a-4040-8aea-1be9a090d74a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:29.062180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bf33f-3d0a-4040-8aea-1be9a090d74a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:29.063645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bf33f-3d0a-4040-8aea-1be9a090d74a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-ce7bf33f-3d0a-4040-8aea-1be9a090d74a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:29.085120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:29.086049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:29.086962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:29.086962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:29.086962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:29.086962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:29.086962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:29.086962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:29.086962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:29.086962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:29.086962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 278/539] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:29.092001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa6e55-bc94-40ca-ad79-6564b75f42db None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:29.126219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:29.180811 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fcc41-e8b8-4c80-8bdd-7c7c2dd830fa None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:29.181136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fcc41-e8b8-4c80-8bdd-7c7c2dd830fa None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:29.181366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fcc41-e8b8-4c80-8bdd-7c7c2dd830fa None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:29.182836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 279/540] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:29.188372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84b676-baa1-4333-a0db-5b8fa990089c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:29.188660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84b676-baa1-4333-a0db-5b8fa990089c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:29.188937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84b676-baa1-4333-a0db-5b8fa990089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:29.217160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ed84b676-baa1-4333-a0db-5b8fa990089c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:29.218362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ed84b676-baa1-4333-a0db-5b8fa990089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:29.269881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa6e55-bc94-40ca-ad79-6564b75f42db None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:29.307086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 280/541] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:21:29.323897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fd7f3-01d4-4d54-8577-0b6af3c0d407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:29.324427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd7f3-01d4-4d54-8577-0b6af3c0d407 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:29.324703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd7f3-01d4-4d54-8577-0b6af3c0d407 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:29.324971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd7f3-01d4-4d54-8577-0b6af3c0d407 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:29.325658 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fd7f3-01d4-4d54-8577-0b6af3c0d407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:29.325959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fd7f3-01d4-4d54-8577-0b6af3c0d407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:29.327413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fd7f3-01d4-4d54-8577-0b6af3c0d407 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:29.339207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 262/542] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:29.345133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84b676-baa1-4333-a0db-5b8fa990089c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:29.446834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84b676-baa1-4333-a0db-5b8fa990089c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:29.471079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:29.482963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c572-a7bf-4397-8e0a-2e7c571497d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:29.483549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c572-a7bf-4397-8e0a-2e7c571497d4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:29.483839 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c572-a7bf-4397-8e0a-2e7c571497d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:29.484168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c572-a7bf-4397-8e0a-2e7c571497d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:29.484895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8c572-a7bf-4397-8e0a-2e7c571497d4 None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=9a186bffa7854d34b91edfa4eb4b2498) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:29.485207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8c572-a7bf-4397-8e0a-2e7c571497d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:29.486875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8c572-a7bf-4397-8e0a-2e7c571497d4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:29.493470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 281/543] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:29 2022] GET /identity/v3/role_assignments?user.id=9a186bffa7854d34b91edfa4eb4b2498&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:29.705497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fd7f3-01d4-4d54-8577-0b6af3c0d407 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:29.787846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:29.819786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fd7f3-01d4-4d54-8577-0b6af3c0d407 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:29.862116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06a91-d866-461e-acb6-2ed66e9c1f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:29.862824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06a91-d866-461e-acb6-2ed66e9c1f98 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:29.863115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06a91-d866-461e-acb6-2ed66e9c1f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:29.863389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06a91-d866-461e-acb6-2ed66e9c1f98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:29.876728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db06a91-d866-461e-acb6-2ed66e9c1f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2db06a91-d866-461e-acb6-2ed66e9c1f98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:29.882295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:29.883228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:29.884021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 263/544] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:29.891969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c572-a7bf-4397-8e0a-2e7c571497d4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:30.031801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c572-a7bf-4397-8e0a-2e7c571497d4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:30.076283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacc6ff-f700-4c9c-9e74-0e0c3808c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:30.076900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacc6ff-f700-4c9c-9e74-0e0c3808c7cd None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:30.077178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacc6ff-f700-4c9c-9e74-0e0c3808c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:30.077448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacc6ff-f700-4c9c-9e74-0e0c3808c7cd None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:30.078116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacc6ff-f700-4c9c-9e74-0e0c3808c7cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:30.078423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacc6ff-f700-4c9c-9e74-0e0c3808c7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:30.079819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacc6ff-f700-4c9c-9e74-0e0c3808c7cd None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:30.094211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 282/545] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:30.099845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06a91-d866-461e-acb6-2ed66e9c1f98 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:30.251346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06a91-d866-461e-acb6-2ed66e9c1f98 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:30.297854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:30.307883 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4e72b-df01-4fc3-9631-db1b7bf04cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:30.308518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4e72b-df01-4fc3-9631-db1b7bf04cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:30.308801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4e72b-df01-4fc3-9631-db1b7bf04cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:30.309072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4e72b-df01-4fc3-9631-db1b7bf04cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:30.319863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4e72b-df01-4fc3-9631-db1b7bf04cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:30.321334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4e72b-df01-4fc3-9631-db1b7bf04cb5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f7a4e72b-df01-4fc3-9631-db1b7bf04cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:30.340390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:30.341328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:30.342178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:30.342178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:30.342178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:30.342178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 264/546] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:30.347748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacc6ff-f700-4c9c-9e74-0e0c3808c7cd None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:30.380984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6200e2b-3f79-46ce-9fa7-c0b169126977 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:30.381341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6200e2b-3f79-46ce-9fa7-c0b169126977 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:30.381532 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6200e2b-3f79-46ce-9fa7-c0b169126977 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:30.383230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 265/547] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:21:30.392775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a219-cca4-46b9-a14c-600dc7f6d09d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:30.393054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a219-cca4-46b9-a14c-600dc7f6d09d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:30.393326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a219-cca4-46b9-a14c-600dc7f6d09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:30.420714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-56c5a219-cca4-46b9-a14c-600dc7f6d09d None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:30.421909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-56c5a219-cca4-46b9-a14c-600dc7f6d09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:30.448505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:30.545124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacc6ff-f700-4c9c-9e74-0e0c3808c7cd None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:30.564770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 266/548] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:30.601010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa02a3-fb5a-4486-9733-227d6ab2a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:30.602045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa02a3-fb5a-4486-9733-227d6ab2a4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:30.602542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa02a3-fb5a-4486-9733-227d6ab2a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:30.603060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa02a3-fb5a-4486-9733-227d6ab2a4e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:30.603903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa02a3-fb5a-4486-9733-227d6ab2a4e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:30.604405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa02a3-fb5a-4486-9733-227d6ab2a4e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:30.605964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa02a3-fb5a-4486-9733-227d6ab2a4e0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:30.618643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 283/549] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:30.623668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5a219-cca4-46b9-a14c-600dc7f6d09d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:30.732529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5a219-cca4-46b9-a14c-600dc7f6d09d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:30.749137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:30.770531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eabe4b-4772-4fcb-abb7-f7419388d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:30.772466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eabe4b-4772-4fcb-abb7-f7419388d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:30.772992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eabe4b-4772-4fcb-abb7-f7419388d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:30.773538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eabe4b-4772-4fcb-abb7-f7419388d0b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:30.781231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eabe4b-4772-4fcb-abb7-f7419388d0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:30.783008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eabe4b-4772-4fcb-abb7-f7419388d0b0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-05eabe4b-4772-4fcb-abb7-f7419388d0b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:30.796643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:30.797881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:30.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:30.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:30.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:30.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:30.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:30.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:30.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:30.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:30.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:21:30.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:30.801691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 267/550] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:30.806966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa02a3-fb5a-4486-9733-227d6ab2a4e0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:30.946715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa02a3-fb5a-4486-9733-227d6ab2a4e0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:30.957592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:30.981240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eabe4b-4772-4fcb-abb7-f7419388d0b0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:31.000824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf8841-d7b7-4eb1-aa7d-91dcabcd46c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:31.001431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf8841-d7b7-4eb1-aa7d-91dcabcd46c7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.001709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf8841-d7b7-4eb1-aa7d-91dcabcd46c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.001969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf8841-d7b7-4eb1-aa7d-91dcabcd46c7 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.002710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf8841-d7b7-4eb1-aa7d-91dcabcd46c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:31.003018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf8841-d7b7-4eb1-aa7d-91dcabcd46c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:31.004448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf8841-d7b7-4eb1-aa7d-91dcabcd46c7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:31.047816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 284/551] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Oct 4 08:21:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:31.054064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf8841-d7b7-4eb1-aa7d-91dcabcd46c7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:31.165209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf8841-d7b7-4eb1-aa7d-91dcabcd46c7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:31.177807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eabe4b-4772-4fcb-abb7-f7419388d0b0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:31.203556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423ff73-2a6b-4748-ad70-627ee4e1c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:31.204084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423ff73-2a6b-4748-ad70-627ee4e1c06a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.204358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423ff73-2a6b-4748-ad70-627ee4e1c06a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.204624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423ff73-2a6b-4748-ad70-627ee4e1c06a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.232856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f8bbe-9498-41b2-b5ac-d86d762fe0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:31.234109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f8bbe-9498-41b2-b5ac-d86d762fe0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.234602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f8bbe-9498-41b2-b5ac-d86d762fe0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.235156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f8bbe-9498-41b2-b5ac-d86d762fe0b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.244144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:31.248622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f8bbe-9498-41b2-b5ac-d86d762fe0b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7c2f8bbe-9498-41b2-b5ac-d86d762fe0b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:31.256066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:31.257742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:31.258573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:31.261439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 268/552] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:31.262875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b373b5-87ab-47ba-a085-836e412046e6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.263413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b373b5-87ab-47ba-a085-836e412046e6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.263904 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b373b5-87ab-47ba-a085-836e412046e6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.269480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 269/553] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:31.270525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b373b5-87ab-47ba-a085-836e412046e6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:31.285361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423ff73-2a6b-4748-ad70-627ee4e1c06a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:31.286926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423ff73-2a6b-4748-ad70-627ee4e1c06a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:31.311580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:31.386706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b373b5-87ab-47ba-a085-836e412046e6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:31.395698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 285/554] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:31.395698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719fa7-1499-42d5-aaf2-2b575682f618 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.395698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719fa7-1499-42d5-aaf2-2b575682f618 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.395698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719fa7-1499-42d5-aaf2-2b575682f618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.411640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e8719fa7-1499-42d5-aaf2-2b575682f618 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:31.412847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e8719fa7-1499-42d5-aaf2-2b575682f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:31.420823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe81d6c-c226-4de4-b564-4959d4d8666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:31.421423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe81d6c-c226-4de4-b564-4959d4d8666d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.421702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe81d6c-c226-4de4-b564-4959d4d8666d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.421971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe81d6c-c226-4de4-b564-4959d4d8666d None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.422620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe81d6c-c226-4de4-b564-4959d4d8666d None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:31.422944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe81d6c-c226-4de4-b564-4959d4d8666d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:31.424298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe81d6c-c226-4de4-b564-4959d4d8666d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:31.438067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 270/555] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:31.439608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902dbc3-649a-4e48-a74b-007b43c1dd44 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.440003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902dbc3-649a-4e48-a74b-007b43c1dd44 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.440151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902dbc3-649a-4e48-a74b-007b43c1dd44 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.441547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 271/556] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:31.442060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902dbc3-649a-4e48-a74b-007b43c1dd44 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:31.491810 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:31.507067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 286/557] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:31.508786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8719fa7-1499-42d5-aaf2-2b575682f618 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:31.555987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:31.563204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902dbc3-649a-4e48-a74b-007b43c1dd44 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:31.603092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec883c15-9c44-48bf-8f9f-8e3f56a709f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:31.603993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec883c15-9c44-48bf-8f9f-8e3f56a709f0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.604450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec883c15-9c44-48bf-8f9f-8e3f56a709f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.604929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec883c15-9c44-48bf-8f9f-8e3f56a709f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.619535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec883c15-9c44-48bf-8f9f-8e3f56a709f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:31.621258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec883c15-9c44-48bf-8f9f-8e3f56a709f0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:31.635851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8719fa7-1499-42d5-aaf2-2b575682f618 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ec883c15-9c44-48bf-8f9f-8e3f56a709f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:31.641352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:31.642282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:31.643206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:31.643206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:31.643206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:31.646787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 272/558] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:31.648877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bde581-a5a1-445f-b61b-0b501d41a3b6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.649368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bde581-a5a1-445f-b61b-0b501d41a3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.650411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bde581-a5a1-445f-b61b-0b501d41a3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.675260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c0bde581-a5a1-445f-b61b-0b501d41a3b6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:31.677730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c0bde581-a5a1-445f-b61b-0b501d41a3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:31.678598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca9094-bcc9-4b38-b8fa-7f53396a35f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:31.679364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca9094-bcc9-4b38-b8fa-7f53396a35f7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.679879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca9094-bcc9-4b38-b8fa-7f53396a35f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.680035 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca9094-bcc9-4b38-b8fa-7f53396a35f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.694363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca9094-bcc9-4b38-b8fa-7f53396a35f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:31.696714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca9094-bcc9-4b38-b8fa-7f53396a35f7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-a5ca9094-bcc9-4b38-b8fa-7f53396a35f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:31.715779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:31.716717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:31.717599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:31.717599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:31.717599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:31.720054 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 287/559] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:31.721188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca9094-bcc9-4b38-b8fa-7f53396a35f7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:31.766762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 273/560] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:31.768159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bde581-a5a1-445f-b61b-0b501d41a3b6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:31.784148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:31.850829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca9094-bcc9-4b38-b8fa-7f53396a35f7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:31.883620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:31.887008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b87c63-6a45-44aa-960c-c36de5208f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:31.887936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b87c63-6a45-44aa-960c-c36de5208f21 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.888563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b87c63-6a45-44aa-960c-c36de5208f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.889048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b87c63-6a45-44aa-960c-c36de5208f21 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.889989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b87c63-6a45-44aa-960c-c36de5208f21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:31.890488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b87c63-6a45-44aa-960c-c36de5208f21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:31.892082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b87c63-6a45-44aa-960c-c36de5208f21 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:31.909701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bde581-a5a1-445f-b61b-0b501d41a3b6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:31.910026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 288/561] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:31.911145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b87c63-6a45-44aa-960c-c36de5208f21 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:31.957090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7065d13-2dea-4dc5-a48e-a3720427a233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:31.957698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7065d13-2dea-4dc5-a48e-a3720427a233 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:31.957978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7065d13-2dea-4dc5-a48e-a3720427a233 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:31.958332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7065d13-2dea-4dc5-a48e-a3720427a233 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:31.959982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7065d13-2dea-4dc5-a48e-a3720427a233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:31.960295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7065d13-2dea-4dc5-a48e-a3720427a233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:31.961966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7065d13-2dea-4dc5-a48e-a3720427a233 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:31.978205 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 274/562] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:31.978830 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7065d13-2dea-4dc5-a48e-a3720427a233 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.029464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b87c63-6a45-44aa-960c-c36de5208f21 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.040719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:32.071436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a39560-be05-4702-8d94-72efe497cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.072088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a39560-be05-4702-8d94-72efe497cf8c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.072363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a39560-be05-4702-8d94-72efe497cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.072632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a39560-be05-4702-8d94-72efe497cf8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.083628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a39560-be05-4702-8d94-72efe497cf8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-f0a39560-be05-4702-8d94-72efe497cf8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:32.088794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:32.089732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 289/563] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:32.091181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a39560-be05-4702-8d94-72efe497cf8c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.107736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7065d13-2dea-4dc5-a48e-a3720427a233 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.149168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168a83c-4c07-41c1-b5c0-ae99e04deb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.149809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a83c-4c07-41c1-b5c0-ae99e04deb20 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.150086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a83c-4c07-41c1-b5c0-ae99e04deb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.150357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a83c-4c07-41c1-b5c0-ae99e04deb20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.157113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168a83c-4c07-41c1-b5c0-ae99e04deb20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:32.158560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168a83c-4c07-41c1-b5c0-ae99e04deb20 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:32.160244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2168a83c-4c07-41c1-b5c0-ae99e04deb20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:32.170970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:32.172109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:32.173014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:32.173014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:32.173014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:32.173014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:32.173014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:32.173014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:32.173014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:32.173014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:32.173014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 275/564] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:32.173498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168a83c-4c07-41c1-b5c0-ae99e04deb20 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.206226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a39560-be05-4702-8d94-72efe497cf8c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.245789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fc7e-9c97-433c-8ef9-33c1078646ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.246339 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fc7e-9c97-433c-8ef9-33c1078646ff None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.246618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fc7e-9c97-433c-8ef9-33c1078646ff None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fc7e-9c97-433c-8ef9-33c1078646ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.254018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482fc7e-9c97-433c-8ef9-33c1078646ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:32.256262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482fc7e-9c97-433c-8ef9-33c1078646ff None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-a482fc7e-9c97-433c-8ef9-33c1078646ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:32.268065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:32.269055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 290/565] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Oct 4 08:21:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:32.269995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fc7e-9c97-433c-8ef9-33c1078646ff None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.288356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168a83c-4c07-41c1-b5c0-ae99e04deb20 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.298842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:32.323064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8dc6c-58f1-434a-be9d-d94ea8f759c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.323679 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8dc6c-58f1-434a-be9d-d94ea8f759c4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.323958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8dc6c-58f1-434a-be9d-d94ea8f759c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.324225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8dc6c-58f1-434a-be9d-d94ea8f759c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.333783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8dc6c-58f1-434a-be9d-d94ea8f759c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f5a8dc6c-58f1-434a-be9d-d94ea8f759c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:32.338933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:32.339891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 276/566] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:32.345840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8dc6c-58f1-434a-be9d-d94ea8f759c4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.369971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fc7e-9c97-433c-8ef9-33c1078646ff None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.396093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:32.403134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d1f1-9dd1-4448-b8a5-9ea8506e7452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.403734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d1f1-9dd1-4448-b8a5-9ea8506e7452 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.404008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d1f1-9dd1-4448-b8a5-9ea8506e7452 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.404286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d1f1-9dd1-4448-b8a5-9ea8506e7452 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.404936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d1f1-9dd1-4448-b8a5-9ea8506e7452 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:32.405244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d1f1-9dd1-4448-b8a5-9ea8506e7452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:32.406604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d1f1-9dd1-4448-b8a5-9ea8506e7452 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:32.415538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 291/567] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:32.416163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d1f1-9dd1-4448-b8a5-9ea8506e7452 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.442096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8dc6c-58f1-434a-be9d-d94ea8f759c4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.477256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a9302-485a-4be0-aca5-1d9c5a1cba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.477865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a9302-485a-4be0-aca5-1d9c5a1cba6e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.478146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a9302-485a-4be0-aca5-1d9c5a1cba6e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.478420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a9302-485a-4be0-aca5-1d9c5a1cba6e None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.479135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a9302-485a-4be0-aca5-1d9c5a1cba6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:32.479444 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a9302-485a-4be0-aca5-1d9c5a1cba6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:32.480880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a9302-485a-4be0-aca5-1d9c5a1cba6e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:32.493156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 277/568] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:32.494361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e688-1a6d-4c07-b23c-7208f2125fde None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.494646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e688-1a6d-4c07-b23c-7208f2125fde None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.494947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e688-1a6d-4c07-b23c-7208f2125fde None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.496180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 278/569] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:32.496813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1e688-1a6d-4c07-b23c-7208f2125fde None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.508303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:32.519189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d1f1-9dd1-4448-b8a5-9ea8506e7452 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.552983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce410006-036e-4200-b1c6-acd5d17db491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.553577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce410006-036e-4200-b1c6-acd5d17db491 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.553850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce410006-036e-4200-b1c6-acd5d17db491 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.554121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce410006-036e-4200-b1c6-acd5d17db491 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.554866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce410006-036e-4200-b1c6-acd5d17db491 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:32.555169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce410006-036e-4200-b1c6-acd5d17db491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:32.556610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce410006-036e-4200-b1c6-acd5d17db491 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:32.572770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 292/570] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Oct 4 08:21:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:32.573548 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce410006-036e-4200-b1c6-acd5d17db491 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.597569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1e688-1a6d-4c07-b23c-7208f2125fde None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.616326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:32.632890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dd719-9da8-46b5-82bc-cbf0f73142d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.633489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd719-9da8-46b5-82bc-cbf0f73142d9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.633764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd719-9da8-46b5-82bc-cbf0f73142d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.634033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd719-9da8-46b5-82bc-cbf0f73142d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.634703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dd719-9da8-46b5-82bc-cbf0f73142d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:32.635016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dd719-9da8-46b5-82bc-cbf0f73142d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:32.636391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dd719-9da8-46b5-82bc-cbf0f73142d9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:32.644140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 279/571] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:32.644930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dd719-9da8-46b5-82bc-cbf0f73142d9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.672279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce410006-036e-4200-b1c6-acd5d17db491 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.706512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fee16-f740-41fc-b667-ca87145f9f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.707161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fee16-f740-41fc-b667-ca87145f9f97 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.707441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fee16-f740-41fc-b667-ca87145f9f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.707714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fee16-f740-41fc-b667-ca87145f9f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.717537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fee16-f740-41fc-b667-ca87145f9f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:32.719017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fee16-f740-41fc-b667-ca87145f9f97 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:32.727626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-7c9fee16-f740-41fc-b667-ca87145f9f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:32.736252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:32.737247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:32.738219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:32.738219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:32.738219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:32.738219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 293/572] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:32.738441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fd5eb-19c3-4b57-a3e5-32bed0cff70e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.738725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fd5eb-19c3-4b57-a3e5-32bed0cff70e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.739028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fd5eb-19c3-4b57-a3e5-32bed0cff70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.747592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dd719-9da8-46b5-82bc-cbf0f73142d9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.756720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b64fd5eb-19c3-4b57-a3e5-32bed0cff70e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:32.757892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b64fd5eb-19c3-4b57-a3e5-32bed0cff70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:32.785366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18b11-c6a2-4ba8-955e-dfd4451b17fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.785998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18b11-c6a2-4ba8-955e-dfd4451b17fb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.786794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18b11-c6a2-4ba8-955e-dfd4451b17fb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.787079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18b11-c6a2-4ba8-955e-dfd4451b17fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.787791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e18b11-c6a2-4ba8-955e-dfd4451b17fb None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=ce739a6448604eae823fd285a0164b47) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:32.788097 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e18b11-c6a2-4ba8-955e-dfd4451b17fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:32.789549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e18b11-c6a2-4ba8-955e-dfd4451b17fb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:32.794688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 280/573] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:32 2022] GET /identity/v3/role_assignments?user.id=ce739a6448604eae823fd285a0164b47&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:32.795463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18b11-c6a2-4ba8-955e-dfd4451b17fb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.834132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 294/574] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:32.834132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fd5eb-19c3-4b57-a3e5-32bed0cff70e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:32.870258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:32.938642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18b11-c6a2-4ba8-955e-dfd4451b17fb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.978555 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd060b9f-e00f-49a9-abd8-b67203548ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:32.979461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060b9f-e00f-49a9-abd8-b67203548ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:32.979738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060b9f-e00f-49a9-abd8-b67203548ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:32.980004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060b9f-e00f-49a9-abd8-b67203548ab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:32.980511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fd5eb-19c3-4b57-a3e5-32bed0cff70e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:32.991366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd060b9f-e00f-49a9-abd8-b67203548ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:32.993105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd060b9f-e00f-49a9-abd8-b67203548ab3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fd060b9f-e00f-49a9-abd8-b67203548ab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:33.010802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:33.011803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:33.013152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:33.013152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:33.013152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:33.013152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 281/575] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:33.013376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd060b9f-e00f-49a9-abd8-b67203548ab3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.026274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:33.033223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e66d5-bdb0-4737-af0a-0fd8b6b936c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.034797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e66d5-bdb0-4737-af0a-0fd8b6b936c6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.035741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e66d5-bdb0-4737-af0a-0fd8b6b936c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.037154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e66d5-bdb0-4737-af0a-0fd8b6b936c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.051090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e66d5-bdb0-4737-af0a-0fd8b6b936c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:33.053163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e66d5-bdb0-4737-af0a-0fd8b6b936c6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-f20e66d5-bdb0-4737-af0a-0fd8b6b936c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:33.068851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:33.069846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:33.071165 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:33.071165 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:33.071165 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:33.071165 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 295/576] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:33.072101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e66d5-bdb0-4737-af0a-0fd8b6b936c6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.144835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:33.154342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd060b9f-e00f-49a9-abd8-b67203548ab3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:33.180573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e66d5-bdb0-4737-af0a-0fd8b6b936c6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:33.190379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc061b6-2869-4f21-be8f-0da4b5b7aa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.191014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc061b6-2869-4f21-be8f-0da4b5b7aa18 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.191293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc061b6-2869-4f21-be8f-0da4b5b7aa18 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.191567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc061b6-2869-4f21-be8f-0da4b5b7aa18 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.192204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc061b6-2869-4f21-be8f-0da4b5b7aa18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:33.192537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc061b6-2869-4f21-be8f-0da4b5b7aa18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:33.194154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc061b6-2869-4f21-be8f-0da4b5b7aa18 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.205877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 282/577] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:33.206664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc061b6-2869-4f21-be8f-0da4b5b7aa18 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.222100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8afb6-8c82-44ee-b042-c37650bfa1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.222747 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8afb6-8c82-44ee-b042-c37650bfa1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.223060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8afb6-8c82-44ee-b042-c37650bfa1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.223336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8afb6-8c82-44ee-b042-c37650bfa1b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.224827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8afb6-8c82-44ee-b042-c37650bfa1b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:33.224827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8afb6-8c82-44ee-b042-c37650bfa1b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:33.226344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8afb6-8c82-44ee-b042-c37650bfa1b3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.239170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 296/578] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:33.240566 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8afb6-8c82-44ee-b042-c37650bfa1b3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.291622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:33.322262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc061b6-2869-4f21-be8f-0da4b5b7aa18 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:33.349687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8afb6-8c82-44ee-b042-c37650bfa1b3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:33.361334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea07c7-68c8-4ac5-a422-618f21170b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.361940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea07c7-68c8-4ac5-a422-618f21170b6e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.362219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea07c7-68c8-4ac5-a422-618f21170b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.362490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea07c7-68c8-4ac5-a422-618f21170b6e None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.363247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea07c7-68c8-4ac5-a422-618f21170b6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:33.363452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea07c7-68c8-4ac5-a422-618f21170b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:33.365542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea07c7-68c8-4ac5-a422-618f21170b6e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.377283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 283/579] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:33.378140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea07c7-68c8-4ac5-a422-618f21170b6e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.390659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66395398-4e8c-49d9-ab32-1652ef15712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.391349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395398-4e8c-49d9-ab32-1652ef15712a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.391622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395398-4e8c-49d9-ab32-1652ef15712a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.391894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395398-4e8c-49d9-ab32-1652ef15712a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.396095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:33.402774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66395398-4e8c-49d9-ab32-1652ef15712a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-66395398-4e8c-49d9-ab32-1652ef15712a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:33.408144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:33.409103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:33.409953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 297/580] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:33.410668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66395398-4e8c-49d9-ab32-1652ef15712a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.499877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea07c7-68c8-4ac5-a422-618f21170b6e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:33.534494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66395398-4e8c-49d9-ab32-1652ef15712a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:33.537469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:33.541598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f86961-fc89-4db0-99d4-a01703bbe79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.542411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f86961-fc89-4db0-99d4-a01703bbe79e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.542774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f86961-fc89-4db0-99d4-a01703bbe79e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.543142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f86961-fc89-4db0-99d4-a01703bbe79e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.552727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f86961-fc89-4db0-99d4-a01703bbe79e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:33.554037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f86961-fc89-4db0-99d4-a01703bbe79e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f7f86961-fc89-4db0-99d4-a01703bbe79e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:33.565420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:33.566622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:33.567973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:33.567973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:33.567973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:33.567973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:33.567973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:33.567973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:33.567973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:33.567973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:33.567973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:21:33.567973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:33.572345 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 284/581] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:33.573207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f86961-fc89-4db0-99d4-a01703bbe79e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.575730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041312b-ef8a-4727-bb07-671cc03a6a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.576429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041312b-ef8a-4727-bb07-671cc03a6a43 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.576704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041312b-ef8a-4727-bb07-671cc03a6a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.576970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041312b-ef8a-4727-bb07-671cc03a6a43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.584618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041312b-ef8a-4727-bb07-671cc03a6a43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:33.586064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041312b-ef8a-4727-bb07-671cc03a6a43 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-4041312b-ef8a-4727-bb07-671cc03a6a43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:33.597364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:33.598427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:33.600057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:33.600057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:33.600057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:33.600057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:33.600057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:33.600057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:33.600057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:33.600057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:33.600057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 298/582] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:33.600057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041312b-ef8a-4727-bb07-671cc03a6a43 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.657648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:33.686564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f86961-fc89-4db0-99d4-a01703bbe79e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:33.717928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041312b-ef8a-4727-bb07-671cc03a6a43 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:33.729053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108f276-0e73-4bc9-a864-5bd38e41ad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.729752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108f276-0e73-4bc9-a864-5bd38e41ad91 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.730205 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108f276-0e73-4bc9-a864-5bd38e41ad91 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.730430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108f276-0e73-4bc9-a864-5bd38e41ad91 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.738484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108f276-0e73-4bc9-a864-5bd38e41ad91 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:33.739997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108f276-0e73-4bc9-a864-5bd38e41ad91 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c108f276-0e73-4bc9-a864-5bd38e41ad91 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:33.752515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:33.753619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:33.754745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 285/583] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:33.756197 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ad176-2626-48c6-92fb-d6542887d7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.756892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ad176-2626-48c6-92fb-d6542887d7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.757246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ad176-2626-48c6-92fb-d6542887d7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.757587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ad176-2626-48c6-92fb-d6542887d7c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.758413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ad176-2626-48c6-92fb-d6542887d7c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:33.758813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ad176-2626-48c6-92fb-d6542887d7c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:33.759104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108f276-0e73-4bc9-a864-5bd38e41ad91 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.760420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ad176-2626-48c6-92fb-d6542887d7c7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.769504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 299/584] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:33.770363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ad176-2626-48c6-92fb-d6542887d7c7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.798913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:33.868522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108f276-0e73-4bc9-a864-5bd38e41ad91 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:33.879611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ad176-2626-48c6-92fb-d6542887d7c7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:33.904378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff521e-1ce6-4b36-8a8b-3e237f26947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.904989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff521e-1ce6-4b36-8a8b-3e237f26947e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.905329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff521e-1ce6-4b36-8a8b-3e237f26947e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.905596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff521e-1ce6-4b36-8a8b-3e237f26947e None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.906250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff521e-1ce6-4b36-8a8b-3e237f26947e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:33.906608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff521e-1ce6-4b36-8a8b-3e237f26947e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:33.908002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff521e-1ce6-4b36-8a8b-3e237f26947e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.910803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:33.915837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f933a9-75d5-46b8-afd2-a3a300ad18c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:33.916459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f933a9-75d5-46b8-afd2-a3a300ad18c1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:33.916756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f933a9-75d5-46b8-afd2-a3a300ad18c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:33.916993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f933a9-75d5-46b8-afd2-a3a300ad18c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:33.917681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f933a9-75d5-46b8-afd2-a3a300ad18c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:33.917986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f933a9-75d5-46b8-afd2-a3a300ad18c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:33.919579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f933a9-75d5-46b8-afd2-a3a300ad18c1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:33.932269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 286/585] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:33.932269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff521e-1ce6-4b36-8a8b-3e237f26947e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:33.940439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 300/586] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:33.940439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f933a9-75d5-46b8-afd2-a3a300ad18c1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.028403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff521e-1ce6-4b36-8a8b-3e237f26947e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:34.028626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:34.047477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f933a9-75d5-46b8-afd2-a3a300ad18c1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:34.063136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6a263-b240-47e7-b6fb-d0359f9c719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:34.063665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a263-b240-47e7-b6fb-d0359f9c719a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:34.063943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a263-b240-47e7-b6fb-d0359f9c719a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:34.064214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a263-b240-47e7-b6fb-d0359f9c719a None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:34.064935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6a263-b240-47e7-b6fb-d0359f9c719a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:34.065239 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6a263-b240-47e7-b6fb-d0359f9c719a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:34.066647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6a263-b240-47e7-b6fb-d0359f9c719a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:34.086736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 287/587] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:34.086736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6a263-b240-47e7-b6fb-d0359f9c719a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.091411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc230508-8f96-4f6f-aafa-2449a53ac271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:34.092048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc230508-8f96-4f6f-aafa-2449a53ac271 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:34.092332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc230508-8f96-4f6f-aafa-2449a53ac271 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:34.092607 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc230508-8f96-4f6f-aafa-2449a53ac271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:34.103629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc230508-8f96-4f6f-aafa-2449a53ac271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:34.105079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc230508-8f96-4f6f-aafa-2449a53ac271 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-fc230508-8f96-4f6f-aafa-2449a53ac271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:34.122115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:34.123157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:34.128821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:34.128821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:34.128821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:34.128821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 301/588] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:34.128821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc230508-8f96-4f6f-aafa-2449a53ac271 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.142335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:34.191010 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6a263-b240-47e7-b6fb-d0359f9c719a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:34.226172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6539ac-95df-4517-aaaf-8700442df517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:34.226820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6539ac-95df-4517-aaaf-8700442df517 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:34.227099 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6539ac-95df-4517-aaaf-8700442df517 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:34.227369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6539ac-95df-4517-aaaf-8700442df517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:34.232983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc230508-8f96-4f6f-aafa-2449a53ac271 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:34.237151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6539ac-95df-4517-aaaf-8700442df517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:34.238590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6539ac-95df-4517-aaaf-8700442df517 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6b6539ac-95df-4517-aaaf-8700442df517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:34.253106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:34.258770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:34.259989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:34.259989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:34.259989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:34.259989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 288/589] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:34.259989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6539ac-95df-4517-aaaf-8700442df517 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.275492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622d4b7-7398-44d3-816c-cdfa463d45c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:34.276153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d4b7-7398-44d3-816c-cdfa463d45c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:34.276432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d4b7-7398-44d3-816c-cdfa463d45c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:34.276834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d4b7-7398-44d3-816c-cdfa463d45c8 None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/2c6603b106fa4db58f3d1b5099606ffa/roles/d228c647a46049f6899439970c288c22` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:34.281206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:34.294720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622d4b7-7398-44d3-816c-cdfa463d45c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=2c6603b106fa4db58f3d1b5099606ffa, role_id=d228c647a46049f6899439970c288c22)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:34.296411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622d4b7-7398-44d3-816c-cdfa463d45c8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:34.310594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 302/590] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:21:34 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/2c6603b106fa4db58f3d1b5099606ffa/roles/d228c647a46049f6899439970c288c22 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:34.311690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622d4b7-7398-44d3-816c-cdfa463d45c8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.374840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6539ac-95df-4517-aaaf-8700442df517 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:34.378631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:34.426452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9aad2-f294-4ac0-b757-fbb01bf826cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:34.427692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9aad2-f294-4ac0-b757-fbb01bf826cf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:34.427980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9aad2-f294-4ac0-b757-fbb01bf826cf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:34.428231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9aad2-f294-4ac0-b757-fbb01bf826cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:34.445122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9aad2-f294-4ac0-b757-fbb01bf826cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:34.446991 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9aad2-f294-4ac0-b757-fbb01bf826cf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-22b9aad2-f294-4ac0-b757-fbb01bf826cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:34.469957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:34.471052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:34.471962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:34.471962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:34.471962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:34.474842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 289/591] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:34.476092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9aad2-f294-4ac0-b757-fbb01bf826cf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.483971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622d4b7-7398-44d3-816c-cdfa463d45c8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:34.533932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1518d3-7fa9-4302-a591-38d73546bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:34.534550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1518d3-7fa9-4302-a591-38d73546bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:34.535203 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1518d3-7fa9-4302-a591-38d73546bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:34.535483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1518d3-7fa9-4302-a591-38d73546bbb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:34.536457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1518d3-7fa9-4302-a591-38d73546bbb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:34.536770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1518d3-7fa9-4302-a591-38d73546bbb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:34.538132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1518d3-7fa9-4302-a591-38d73546bbb3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:34.550546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 303/592] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:34.551644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1518d3-7fa9-4302-a591-38d73546bbb3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.603191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:34.623724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9aad2-f294-4ac0-b757-fbb01bf826cf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:34.658394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001dfdf-2c4e-4cc2-a19a-bb0d801d8845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:34.658966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001dfdf-2c4e-4cc2-a19a-bb0d801d8845 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:34.659243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001dfdf-2c4e-4cc2-a19a-bb0d801d8845 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:34.659516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001dfdf-2c4e-4cc2-a19a-bb0d801d8845 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:34.660155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001dfdf-2c4e-4cc2-a19a-bb0d801d8845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:34.660454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001dfdf-2c4e-4cc2-a19a-bb0d801d8845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:34.662391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001dfdf-2c4e-4cc2-a19a-bb0d801d8845 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:34.679776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 290/593] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:34.679776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001dfdf-2c4e-4cc2-a19a-bb0d801d8845 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.682761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1518d3-7fa9-4302-a591-38d73546bbb3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:34.702304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:34.727987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f7b4-6401-40b3-944b-7b322fcb208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:34.728933 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f7b4-6401-40b3-944b-7b322fcb208d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:34.729504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f7b4-6401-40b3-944b-7b322fcb208d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:34.730078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f7b4-6401-40b3-944b-7b322fcb208d None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:34.731442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803f7b4-6401-40b3-944b-7b322fcb208d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:34.732060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803f7b4-6401-40b3-944b-7b322fcb208d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:34.734043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803f7b4-6401-40b3-944b-7b322fcb208d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:34.750233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 304/594] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:34.752094 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f7b4-6401-40b3-944b-7b322fcb208d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.813140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001dfdf-2c4e-4cc2-a19a-bb0d801d8845 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:34.857127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb2e9a-5e30-417c-b5ab-b76ceb058fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:34.857914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb2e9a-5e30-417c-b5ab-b76ceb058fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:34.858352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb2e9a-5e30-417c-b5ab-b76ceb058fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:34.858802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb2e9a-5e30-417c-b5ab-b76ceb058fc9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:34.868300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb2e9a-5e30-417c-b5ab-b76ceb058fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:34.870512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb2e9a-5e30-417c-b5ab-b76ceb058fc9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:34.876268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f7b4-6401-40b3-944b-7b322fcb208d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:34.888441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-98cb2e9a-5e30-417c-b5ab-b76ceb058fc9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:34.889121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:34.890236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:34.891480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:34.891480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:34.891480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:34.891480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:34.891480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:34.891480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:34.891480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:34.891480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:34.891480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:21:34.891480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:34.895273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 291/595] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:34.895273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb2e9a-5e30-417c-b5ab-b76ceb058fc9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.924403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f0e3d-ec07-4a59-92e9-4844bc41c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:34.925350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f0e3d-ec07-4a59-92e9-4844bc41c57c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:34.926038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f0e3d-ec07-4a59-92e9-4844bc41c57c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:34.926458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f0e3d-ec07-4a59-92e9-4844bc41c57c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:34.934526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f0e3d-ec07-4a59-92e9-4844bc41c57c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:34.937214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f0e3d-ec07-4a59-92e9-4844bc41c57c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-ec3f0e3d-ec07-4a59-92e9-4844bc41c57c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:34.950774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:34.951856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:34.952953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:34.952953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:34.952953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:34.952953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:34.952953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:34.952953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:34.952953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:34.952953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:34.955449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 305/596] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:34.956431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f0e3d-ec07-4a59-92e9-4844bc41c57c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:34.996712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:35.026880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb2e9a-5e30-417c-b5ab-b76ceb058fc9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:35.062321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d7c4a-c9a6-4263-9a89-b4f18292b78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:35.063129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d7c4a-c9a6-4263-9a89-b4f18292b78c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:35.063713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d7c4a-c9a6-4263-9a89-b4f18292b78c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:35.063994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d7c4a-c9a6-4263-9a89-b4f18292b78c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:35.066161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f0e3d-ec07-4a59-92e9-4844bc41c57c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:35.072024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d7c4a-c9a6-4263-9a89-b4f18292b78c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:35.073488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d7c4a-c9a6-4263-9a89-b4f18292b78c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-285d7c4a-c9a6-4263-9a89-b4f18292b78c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:35.085689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:35.086599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:35.087610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:35.087610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:35.087610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:35.087610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:35.087610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:35.087610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:35.087610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:35.087610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:35.091502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 292/597] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:35.092376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d7c4a-c9a6-4263-9a89-b4f18292b78c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:35.103431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa428ac-c7da-408c-8715-1543a2792207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:35.104048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa428ac-c7da-408c-8715-1543a2792207 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:35.104376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa428ac-c7da-408c-8715-1543a2792207 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:35.105024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa428ac-c7da-408c-8715-1543a2792207 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:35.105763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa428ac-c7da-408c-8715-1543a2792207 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:35.106382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa428ac-c7da-408c-8715-1543a2792207 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:35.107851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa428ac-c7da-408c-8715-1543a2792207 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:35.130767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 306/598] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Oct 4 08:21:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:35.130767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00939d4-15ec-4bad-84d0-a7c91ec54b6f None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:35.130767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00939d4-15ec-4bad-84d0-a7c91ec54b6f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:35.130767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00939d4-15ec-4bad-84d0-a7c91ec54b6f None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:35.130767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 307/599] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:35.131228 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00939d4-15ec-4bad-84d0-a7c91ec54b6f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:35.156186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:35.205311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d7c4a-c9a6-4263-9a89-b4f18292b78c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:35.239215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13aa08-4286-4bdd-ac9e-7b9e466fb814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:35.240366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13aa08-4286-4bdd-ac9e-7b9e466fb814 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:35.240657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13aa08-4286-4bdd-ac9e-7b9e466fb814 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:35.240929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13aa08-4286-4bdd-ac9e-7b9e466fb814 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:35.241638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13aa08-4286-4bdd-ac9e-7b9e466fb814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:35.241884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00939d4-15ec-4bad-84d0-a7c91ec54b6f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:35.242007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13aa08-4286-4bdd-ac9e-7b9e466fb814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:35.243466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13aa08-4286-4bdd-ac9e-7b9e466fb814 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:35.247476 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:35.265927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 293/600] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:35.265927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13aa08-4286-4bdd-ac9e-7b9e466fb814 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:35.288150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde75daa-9b04-4631-8518-04b52ef97c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:35.288762 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde75daa-9b04-4631-8518-04b52ef97c71 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:35.289038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde75daa-9b04-4631-8518-04b52ef97c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:35.289308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde75daa-9b04-4631-8518-04b52ef97c71 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:35.289990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde75daa-9b04-4631-8518-04b52ef97c71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:35.290814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde75daa-9b04-4631-8518-04b52ef97c71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:35.292248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde75daa-9b04-4631-8518-04b52ef97c71 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:35.310867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 308/601] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:35.316017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29254-4a9d-4063-81ad-88825268fab2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:35.316401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29254-4a9d-4063-81ad-88825268fab2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:35.316773 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29254-4a9d-4063-81ad-88825268fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:35.336777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-26e29254-4a9d-4063-81ad-88825268fab2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:35.337974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-26e29254-4a9d-4063-81ad-88825268fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:35.387537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13aa08-4286-4bdd-ac9e-7b9e466fb814 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:35.414219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 309/602] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:35.415103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e29254-4a9d-4063-81ad-88825268fab2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:35.442140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:35.447417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cac0d4-1a61-49ef-9bfa-71df92ca664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:35.448254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cac0d4-1a61-49ef-9bfa-71df92ca664d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:35.448690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cac0d4-1a61-49ef-9bfa-71df92ca664d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:35.449110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cac0d4-1a61-49ef-9bfa-71df92ca664d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:35.462339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cac0d4-1a61-49ef-9bfa-71df92ca664d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:35.464712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cac0d4-1a61-49ef-9bfa-71df92ca664d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b6cac0d4-1a61-49ef-9bfa-71df92ca664d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:35.483356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:35.484368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:35.485364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:35.485364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:35.485364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:35.485364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 294/603] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:35.486041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cac0d4-1a61-49ef-9bfa-71df92ca664d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:35.566503 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:35.576087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e29254-4a9d-4063-81ad-88825268fab2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:35.627834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b6964-0c05-406b-b952-b18ffa58b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:35.629020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b6964-0c05-406b-b952-b18ffa58b868 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:35.629539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b6964-0c05-406b-b952-b18ffa58b868 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:35.630541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b6964-0c05-406b-b952-b18ffa58b868 None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/7b2324f9166d4c2dac76f08b03991769/roles/d228c647a46049f6899439970c288c22` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:35.640411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cac0d4-1a61-49ef-9bfa-71df92ca664d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:35.649890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b6964-0c05-406b-b952-b18ffa58b868 None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=7b2324f9166d4c2dac76f08b03991769, role_id=d228c647a46049f6899439970c288c22)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:35.651794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b6964-0c05-406b-b952-b18ffa58b868 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:35.671771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 310/604] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:21:35 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/7b2324f9166d4c2dac76f08b03991769/roles/d228c647a46049f6899439970c288c22 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:35.672925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b6964-0c05-406b-b952-b18ffa58b868 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:35.688980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f91448-9128-4bdd-821d-130b0b815d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:35.689894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91448-9128-4bdd-821d-130b0b815d90 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:35.690558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91448-9128-4bdd-821d-130b0b815d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:35.691184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91448-9128-4bdd-821d-130b0b815d90 None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/53db39d8c5d1459294b0376d052a9495/roles/d228c647a46049f6899439970c288c22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:35.714143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f91448-9128-4bdd-821d-130b0b815d90 None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=53db39d8c5d1459294b0376d052a9495, role_id=d228c647a46049f6899439970c288c22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:35.715812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f91448-9128-4bdd-821d-130b0b815d90 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:35.742646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 295/605] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:21:35 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/53db39d8c5d1459294b0376d052a9495/roles/d228c647a46049f6899439970c288c22 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:35.774716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:35.782977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f91448-9128-4bdd-821d-130b0b815d90 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:35.825487 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b6964-0c05-406b-b952-b18ffa58b868 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:35.875621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34942c8a-9555-4de0-aa6e-975621b1eb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:35.876345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34942c8a-9555-4de0-aa6e-975621b1eb15 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:35.876634 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34942c8a-9555-4de0-aa6e-975621b1eb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:35.876909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34942c8a-9555-4de0-aa6e-975621b1eb15 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:35.877569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34942c8a-9555-4de0-aa6e-975621b1eb15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:35.877876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34942c8a-9555-4de0-aa6e-975621b1eb15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:35.879348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34942c8a-9555-4de0-aa6e-975621b1eb15 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:35.894403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 311/606] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:35.901049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34942c8a-9555-4de0-aa6e-975621b1eb15 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:36.005873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:36.013856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f91448-9128-4bdd-821d-130b0b815d90 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:36.075508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d00a1-e526-4e0c-9224-9f3c9c2fa4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:36.076928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d00a1-e526-4e0c-9224-9f3c9c2fa4dd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:36.077399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d00a1-e526-4e0c-9224-9f3c9c2fa4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:36.077734 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d00a1-e526-4e0c-9224-9f3c9c2fa4dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:36.090489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d00a1-e526-4e0c-9224-9f3c9c2fa4dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-901d00a1-e526-4e0c-9224-9f3c9c2fa4dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:36.095507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:36.096489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:36.097346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 296/607] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:36.103885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d00a1-e526-4e0c-9224-9f3c9c2fa4dd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:36.105343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34942c8a-9555-4de0-aa6e-975621b1eb15 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:36.144717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:36.163638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fd22a-afa7-474e-80de-2b3234b083cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:36.164531 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fd22a-afa7-474e-80de-2b3234b083cb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:36.165608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fd22a-afa7-474e-80de-2b3234b083cb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:36.166043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fd22a-afa7-474e-80de-2b3234b083cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:36.179178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fd22a-afa7-474e-80de-2b3234b083cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:36.181009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fd22a-afa7-474e-80de-2b3234b083cb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-109fd22a-afa7-474e-80de-2b3234b083cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:36.198280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:36.199451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:36.201101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:36.201101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:36.201101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:36.201101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:36.201101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:36.201101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:36.201101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:36.201101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:36.203980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 312/608] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:36.212748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fd22a-afa7-474e-80de-2b3234b083cb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:36.306417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d00a1-e526-4e0c-9224-9f3c9c2fa4dd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:36.346010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fd22a-afa7-474e-80de-2b3234b083cb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:36.378646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f32723-42ab-438b-a177-7c8a9a5eef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:36.379425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f32723-42ab-438b-a177-7c8a9a5eef45 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:36.379665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f32723-42ab-438b-a177-7c8a9a5eef45 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:36.379990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f32723-42ab-438b-a177-7c8a9a5eef45 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:36.380669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f32723-42ab-438b-a177-7c8a9a5eef45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:36.380990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f32723-42ab-438b-a177-7c8a9a5eef45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:36.382370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f32723-42ab-438b-a177-7c8a9a5eef45 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:36.388925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d2ed8-1279-42c1-9136-1d39cf6d6432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:36.389835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2ed8-1279-42c1-9136-1d39cf6d6432 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:36.390401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2ed8-1279-42c1-9136-1d39cf6d6432 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:36.390900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2ed8-1279-42c1-9136-1d39cf6d6432 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:36.392382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d2ed8-1279-42c1-9136-1d39cf6d6432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:36.392931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d2ed8-1279-42c1-9136-1d39cf6d6432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:36.394691 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d2ed8-1279-42c1-9136-1d39cf6d6432 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:36.401051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 297/609] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:36.406717 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f32723-42ab-438b-a177-7c8a9a5eef45 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:36.410232 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 313/610] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:36.417094 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d2ed8-1279-42c1-9136-1d39cf6d6432 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:36.458495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:36.510623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:36.609989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d2ed8-1279-42c1-9136-1d39cf6d6432 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:36.612143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f32723-42ab-438b-a177-7c8a9a5eef45 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:36.673640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad686db-5796-483a-ace5-58e835bb9015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:36.674312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad686db-5796-483a-ace5-58e835bb9015 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:36.674582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad686db-5796-483a-ace5-58e835bb9015 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:36.674947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad686db-5796-483a-ace5-58e835bb9015 None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/9a186bffa7854d34b91edfa4eb4b2498/roles/d228c647a46049f6899439970c288c22` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:36.677468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c766c51-d675-446b-b846-c82a7dbb797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:36.678362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c766c51-d675-446b-b846-c82a7dbb797c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:36.678898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c766c51-d675-446b-b846-c82a7dbb797c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:36.679393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c766c51-d675-446b-b846-c82a7dbb797c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:36.690843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad686db-5796-483a-ace5-58e835bb9015 None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=9a186bffa7854d34b91edfa4eb4b2498, role_id=d228c647a46049f6899439970c288c22)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:36.691510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c766c51-d675-446b-b846-c82a7dbb797c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:36.692303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad686db-5796-483a-ace5-58e835bb9015 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:36.693577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c766c51-d675-446b-b846-c82a7dbb797c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:36.710777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 314/611] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:21:36 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/9a186bffa7854d34b91edfa4eb4b2498/roles/d228c647a46049f6899439970c288c22 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:36.710777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6f80-ed2d-411b-9ad3-6405b2f2d0ce None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:36.710777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6f80-ed2d-411b-9ad3-6405b2f2d0ce None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:36.710777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6f80-ed2d-411b-9ad3-6405b2f2d0ce None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:36.711936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 315/612] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0c766c51-d675-446b-b846-c82a7dbb797c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:36.718882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:36.720075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:36.721115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:36.721115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:36.721115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:36.721115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 298/613] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:36.729334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a6f80-ed2d-411b-9ad3-6405b2f2d0ce None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:36.738252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec817665-8189-421d-b870-99a388446d9e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:36.738252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec817665-8189-421d-b870-99a388446d9e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:36.738252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec817665-8189-421d-b870-99a388446d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:36.775437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ec817665-8189-421d-b870-99a388446d9e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:36.778180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ec817665-8189-421d-b870-99a388446d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:36.930778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 299/614] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:36.933816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:36.943608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a6f80-ed2d-411b-9ad3-6405b2f2d0ce None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:36.981783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f84cf-5621-4520-bd88-60f5fdfecbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:36.982387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f84cf-5621-4520-bd88-60f5fdfecbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:36.982659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f84cf-5621-4520-bd88-60f5fdfecbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:36.982952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f84cf-5621-4520-bd88-60f5fdfecbf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:36.983588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f84cf-5621-4520-bd88-60f5fdfecbf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:36.983887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f84cf-5621-4520-bd88-60f5fdfecbf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:36.985254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f84cf-5621-4520-bd88-60f5fdfecbf2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:37.000857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 316/615] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:37.002249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec817665-8189-421d-b870-99a388446d9e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:37.005466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:37.155148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec817665-8189-421d-b870-99a388446d9e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:37.206375 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65700bca-d4c0-4c91-b401-a14e5b47aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:37.207031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65700bca-d4c0-4c91-b401-a14e5b47aeaf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:37.207312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65700bca-d4c0-4c91-b401-a14e5b47aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:37.207592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65700bca-d4c0-4c91-b401-a14e5b47aeaf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:37.217583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65700bca-d4c0-4c91-b401-a14e5b47aeaf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:37.219055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65700bca-d4c0-4c91-b401-a14e5b47aeaf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-65700bca-d4c0-4c91-b401-a14e5b47aeaf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:37.234977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:37.235953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:37.237320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 300/616] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:37.244091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f84cf-5621-4520-bd88-60f5fdfecbf2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:37.322662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65700bca-d4c0-4c91-b401-a14e5b47aeaf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:37.378403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f84cf-5621-4520-bd88-60f5fdfecbf2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:37.443674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd99c-fc66-4596-af6c-997e645b0a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:37.444285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd99c-fc66-4596-af6c-997e645b0a9f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:37.444569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd99c-fc66-4596-af6c-997e645b0a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:37.444843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd99c-fc66-4596-af6c-997e645b0a9f None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:37.445581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cd99c-fc66-4596-af6c-997e645b0a9f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:37.445892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cd99c-fc66-4596-af6c-997e645b0a9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:37.449112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cd99c-fc66-4596-af6c-997e645b0a9f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:37.461043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:37.500748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 317/617] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Oct 4 08:21:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:37.509264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd99c-fc66-4596-af6c-997e645b0a9f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:37.526903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65700bca-d4c0-4c91-b401-a14e5b47aeaf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:37.540265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:37.579395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fed020-51a2-4894-a618-b182d8961f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:37.580048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fed020-51a2-4894-a618-b182d8961f07 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:37.580325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fed020-51a2-4894-a618-b182d8961f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:37.580608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fed020-51a2-4894-a618-b182d8961f07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:37.615701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fed020-51a2-4894-a618-b182d8961f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e9fed020-51a2-4894-a618-b182d8961f07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:37.621044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:37.622018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:37.622887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:37.631141 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 301/618] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:37.636540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fed020-51a2-4894-a618-b182d8961f07 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:37.650365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd99c-fc66-4596-af6c-997e645b0a9f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:37.687178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456838-614b-4d96-bb12-904dc6594d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:37.688215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456838-614b-4d96-bb12-904dc6594d0d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:37.688780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456838-614b-4d96-bb12-904dc6594d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:37.689280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456838-614b-4d96-bb12-904dc6594d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:37.701011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db456838-614b-4d96-bb12-904dc6594d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:37.710895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db456838-614b-4d96-bb12-904dc6594d0d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-db456838-614b-4d96-bb12-904dc6594d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:37.731353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:37.732486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:37.733374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:37.733374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:37.733374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:37.735366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 318/619] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:37.743601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456838-614b-4d96-bb12-904dc6594d0d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:37.778553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fed020-51a2-4894-a618-b182d8961f07 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:37.802614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:37.816081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb957a5-1a77-468b-b661-66c082e83d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:37.816935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb957a5-1a77-468b-b661-66c082e83d28 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:37.817898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb957a5-1a77-468b-b661-66c082e83d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:37.818296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb957a5-1a77-468b-b661-66c082e83d28 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:37.819126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb957a5-1a77-468b-b661-66c082e83d28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:37.819594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb957a5-1a77-468b-b661-66c082e83d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:37.821103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb957a5-1a77-468b-b661-66c082e83d28 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:37.834385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 302/620] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:37.835868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb957a5-1a77-468b-b661-66c082e83d28 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:37.862189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:37.940427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456838-614b-4d96-bb12-904dc6594d0d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:38.007104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93fae-966f-4640-ac20-ce353a0ad99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:38.007643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93fae-966f-4640-ac20-ce353a0ad99b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.007922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93fae-966f-4640-ac20-ce353a0ad99b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.008194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93fae-966f-4640-ac20-ce353a0ad99b None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.008937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93fae-966f-4640-ac20-ce353a0ad99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:38.009245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93fae-966f-4640-ac20-ce353a0ad99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:38.010754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93fae-966f-4640-ac20-ce353a0ad99b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:38.012376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb957a5-1a77-468b-b661-66c082e83d28 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:38.036717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 319/621] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:38.042574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93fae-966f-4640-ac20-ce353a0ad99b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:38.047694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32509e37-3640-4651-91b1-bfcbdd3df6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:38.048321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509e37-3640-4651-91b1-bfcbdd3df6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.048597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509e37-3640-4651-91b1-bfcbdd3df6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.048867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509e37-3640-4651-91b1-bfcbdd3df6d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.060398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32509e37-3640-4651-91b1-bfcbdd3df6d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:38.061968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32509e37-3640-4651-91b1-bfcbdd3df6d7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-32509e37-3640-4651-91b1-bfcbdd3df6d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:38.076589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:38.077608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:38.078538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:38.078538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:38.078538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:38.081751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 303/622] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:38.084665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32509e37-3640-4651-91b1-bfcbdd3df6d7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:38.128302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:38.199969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32509e37-3640-4651-91b1-bfcbdd3df6d7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:38.230700 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93fae-966f-4640-ac20-ce353a0ad99b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:38.237437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd49e-0ed4-4da9-a019-fca8fba570e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:38.238040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd49e-0ed4-4da9-a019-fca8fba570e9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.238317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd49e-0ed4-4da9-a019-fca8fba570e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.238591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd49e-0ed4-4da9-a019-fca8fba570e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.239801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cd49e-0ed4-4da9-a019-fca8fba570e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:38.240105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cd49e-0ed4-4da9-a019-fca8fba570e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:38.241608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cd49e-0ed4-4da9-a019-fca8fba570e9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:38.256702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:38.259226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 304/623] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:38.260345 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776eb0e-029c-4c23-96e6-ca6aedadb671 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.260664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776eb0e-029c-4c23-96e6-ca6aedadb671 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.260890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776eb0e-029c-4c23-96e6-ca6aedadb671 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.262778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 305/624] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:38.263496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776eb0e-029c-4c23-96e6-ca6aedadb671 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:38.274847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80a2bc-4b0f-42ae-920a-6867cf1f571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:38.275485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a2bc-4b0f-42ae-920a-6867cf1f571a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.275762 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a2bc-4b0f-42ae-920a-6867cf1f571a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.276339 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a2bc-4b0f-42ae-920a-6867cf1f571a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.284193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80a2bc-4b0f-42ae-920a-6867cf1f571a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:38.286199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80a2bc-4b0f-42ae-920a-6867cf1f571a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-4b80a2bc-4b0f-42ae-920a-6867cf1f571a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:38.299751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:38.301158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:38.303167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:38.303167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:38.303167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:38.303167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:38.303167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:38.303167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:38.303167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:38.303167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:38.306577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 320/625] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:38.308749 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64ee6c-cc2b-4c53-b0ce-1c61d24612d4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.309031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64ee6c-cc2b-4c53-b0ce-1c61d24612d4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.309303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64ee6c-cc2b-4c53-b0ce-1c61d24612d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.330100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8a64ee6c-cc2b-4c53-b0ce-1c61d24612d4 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:38.331319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8a64ee6c-cc2b-4c53-b0ce-1c61d24612d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:38.371138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:38.377544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776eb0e-029c-4c23-96e6-ca6aedadb671 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:38.410632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 321/626] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:38.412017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64ee6c-cc2b-4c53-b0ce-1c61d24612d4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:38.419693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe5ee0-bdbb-46e0-a5d8-ad1a970de59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:38.421239 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe5ee0-bdbb-46e0-a5d8-ad1a970de59f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.421612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe5ee0-bdbb-46e0-a5d8-ad1a970de59f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.423284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe5ee0-bdbb-46e0-a5d8-ad1a970de59f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.439311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe5ee0-bdbb-46e0-a5d8-ad1a970de59f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:38.440771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe5ee0-bdbb-46e0-a5d8-ad1a970de59f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0abe5ee0-bdbb-46e0-a5d8-ad1a970de59f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:38.463876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:38.466597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:38.468891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:38.468891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:38.468891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:38.468891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:38.468891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:38.468891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:38.468891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:38.468891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:38.468891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:38.468891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:38.478815 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 306/627] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Oct 4 08:21:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:38.478815 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe5ee0-bdbb-46e0-a5d8-ad1a970de59f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:38.602106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64ee6c-cc2b-4c53-b0ce-1c61d24612d4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:38.636136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:38.666696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe5ee0-bdbb-46e0-a5d8-ad1a970de59f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:38.678414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24cf80-6687-4df8-8a1e-61d35e70d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:38.679056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24cf80-6687-4df8-8a1e-61d35e70d6eb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.679335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24cf80-6687-4df8-8a1e-61d35e70d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.679649 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24cf80-6687-4df8-8a1e-61d35e70d6eb None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.680407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24cf80-6687-4df8-8a1e-61d35e70d6eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:38.680758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24cf80-6687-4df8-8a1e-61d35e70d6eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:38.682188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24cf80-6687-4df8-8a1e-61d35e70d6eb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:38.703248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 322/628] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:38.711054 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24cf80-6687-4df8-8a1e-61d35e70d6eb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:38.744427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce67b4b-1202-4029-b680-0dba137e5b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:38.745105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce67b4b-1202-4029-b680-0dba137e5b30 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.745385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce67b4b-1202-4029-b680-0dba137e5b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.745657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce67b4b-1202-4029-b680-0dba137e5b30 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.746435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce67b4b-1202-4029-b680-0dba137e5b30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:38.746824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce67b4b-1202-4029-b680-0dba137e5b30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:38.748332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce67b4b-1202-4029-b680-0dba137e5b30 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:38.773217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 307/629] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Oct 4 08:21:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:38.773217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce67b4b-1202-4029-b680-0dba137e5b30 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:38.786734 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:38.838723 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24cf80-6687-4df8-8a1e-61d35e70d6eb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:38.873941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2cbbf-d6c4-40c1-aed2-03765ecde776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:38.874518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2cbbf-d6c4-40c1-aed2-03765ecde776 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.874836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2cbbf-d6c4-40c1-aed2-03765ecde776 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.875117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2cbbf-d6c4-40c1-aed2-03765ecde776 None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/ce739a6448604eae823fd285a0164b47/roles/d228c647a46049f6899439970c288c22` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.879057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce67b4b-1202-4029-b680-0dba137e5b30 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:38.890730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2cbbf-d6c4-40c1-aed2-03765ecde776 None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=ce739a6448604eae823fd285a0164b47, role_id=d228c647a46049f6899439970c288c22)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:38.892176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2cbbf-d6c4-40c1-aed2-03765ecde776 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:38.914716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 323/630] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:21:38 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/ce739a6448604eae823fd285a0164b47/roles/d228c647a46049f6899439970c288c22 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:21:38.914716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2cbbf-d6c4-40c1-aed2-03765ecde776 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:38.930322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69376ea7-37ea-4cce-8aa0-55a3f2b50444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:38.931246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69376ea7-37ea-4cce-8aa0-55a3f2b50444 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.931582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69376ea7-37ea-4cce-8aa0-55a3f2b50444 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.931925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69376ea7-37ea-4cce-8aa0-55a3f2b50444 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.943030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:38.946571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69376ea7-37ea-4cce-8aa0-55a3f2b50444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-69376ea7-37ea-4cce-8aa0-55a3f2b50444 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:38.959791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:38.961762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:38.962858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:38.965455 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 308/631] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:38.967083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0df9-b538-4387-874c-4300771f8691 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:38.967614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0df9-b538-4387-874c-4300771f8691 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:38.968060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0df9-b538-4387-874c-4300771f8691 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:38.975561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 309/632] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:38.976795 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0df9-b538-4387-874c-4300771f8691 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:39.038114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2cbbf-d6c4-40c1-aed2-03765ecde776 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:39.079667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fd915-1e2a-4535-9cf6-e3b9ea1b02a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:39.080434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fd915-1e2a-4535-9cf6-e3b9ea1b02a5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.080813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fd915-1e2a-4535-9cf6-e3b9ea1b02a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.081189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fd915-1e2a-4535-9cf6-e3b9ea1b02a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.104389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:39.141874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0df9-b538-4387-874c-4300771f8691 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:39.172599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fd915-1e2a-4535-9cf6-e3b9ea1b02a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:39.174224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fd915-1e2a-4535-9cf6-e3b9ea1b02a5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:39.199393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad261197-fbdc-4826-89f7-ae00ac7a8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:39.200376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad261197-fbdc-4826-89f7-ae00ac7a8017 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.200657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad261197-fbdc-4826-89f7-ae00ac7a8017 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.201032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad261197-fbdc-4826-89f7-ae00ac7a8017 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.201842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad261197-fbdc-4826-89f7-ae00ac7a8017 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:39.202255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad261197-fbdc-4826-89f7-ae00ac7a8017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:39.203936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad261197-fbdc-4826-89f7-ae00ac7a8017 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:39.209642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:39.218748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 310/633] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:39.220444 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4571f1-1b20-4eee-94c5-40cb82e9d7c9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.221025 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4571f1-1b20-4eee-94c5-40cb82e9d7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.222749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4571f1-1b20-4eee-94c5-40cb82e9d7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.249937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0d4571f1-1b20-4eee-94c5-40cb82e9d7c9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:39.251381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0d4571f1-1b20-4eee-94c5-40cb82e9d7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:39.321008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 324/634] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:39.321869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fd915-1e2a-4535-9cf6-e3b9ea1b02a5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:39.334279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 311/635] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:39.335765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b677065-4637-4645-874a-ca9d4b8f1e6e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.336049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b677065-4637-4645-874a-ca9d4b8f1e6e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.336322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b677065-4637-4645-874a-ca9d4b8f1e6e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.337722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 312/636] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:39.338206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b677065-4637-4645-874a-ca9d4b8f1e6e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:39.428053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:39.453146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fd915-1e2a-4535-9cf6-e3b9ea1b02a5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:39.467029 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b677065-4637-4645-874a-ca9d4b8f1e6e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:39.488672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:39.506728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae124c0-e0e1-428e-8c17-88ca71b7df6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:39.507178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1f8c-181a-408b-9f19-42f4de0718e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:39.507384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae124c0-e0e1-428e-8c17-88ca71b7df6e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.507663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae124c0-e0e1-428e-8c17-88ca71b7df6e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.507934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae124c0-e0e1-428e-8c17-88ca71b7df6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.508820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1f8c-181a-408b-9f19-42f4de0718e2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.509304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1f8c-181a-408b-9f19-42f4de0718e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.510044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1f8c-181a-408b-9f19-42f4de0718e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.518527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae124c0-e0e1-428e-8c17-88ca71b7df6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:39.520394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae124c0-e0e1-428e-8c17-88ca71b7df6e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:39.525434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d1f8c-181a-408b-9f19-42f4de0718e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:39.527183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d1f8c-181a-408b-9f19-42f4de0718e2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6ae124c0-e0e1-428e-8c17-88ca71b7df6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:39.535833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:39.537445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:39.538357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:39.538357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:39.538357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:39.542177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 313/637] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:39.543446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2e28e-2b68-45f1-a8b0-0963e91d347c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.543728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2e28e-2b68-45f1-a8b0-0963e91d347c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.544001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2e28e-2b68-45f1-a8b0-0963e91d347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-fc8d1f8c-181a-408b-9f19-42f4de0718e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:39.548190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:39.549135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:39.550026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:39.550026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:39.550026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:39.552944 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 325/638] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:39.553996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1f8c-181a-408b-9f19-42f4de0718e2 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:39.569501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5fe2e28e-2b68-45f1-a8b0-0963e91d347c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:39.570892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5fe2e28e-2b68-45f1-a8b0-0963e91d347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:39.638899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 314/639] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:39.639910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2e28e-2b68-45f1-a8b0-0963e91d347c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:39.688266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1f8c-181a-408b-9f19-42f4de0718e2 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:39.693020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:39.726944 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b9791-c766-4fd5-ad73-609aad2b1c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:39.727731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b9791-c766-4fd5-ad73-609aad2b1c91 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.728094 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b9791-c766-4fd5-ad73-609aad2b1c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.728461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b9791-c766-4fd5-ad73-609aad2b1c91 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.729298 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b9791-c766-4fd5-ad73-609aad2b1c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:39.729699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b9791-c766-4fd5-ad73-609aad2b1c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:39.731186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b9791-c766-4fd5-ad73-609aad2b1c91 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:39.748732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 326/640] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:39.749735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b9791-c766-4fd5-ad73-609aad2b1c91 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:39.759234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2e28e-2b68-45f1-a8b0-0963e91d347c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:39.796971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:39.800512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a3e69-ed39-4ba6-ad7e-709a5932f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:39.801483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a3e69-ed39-4ba6-ad7e-709a5932f9ff None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.802085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a3e69-ed39-4ba6-ad7e-709a5932f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.802454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a3e69-ed39-4ba6-ad7e-709a5932f9ff None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.803238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a3e69-ed39-4ba6-ad7e-709a5932f9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:39.803636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a3e69-ed39-4ba6-ad7e-709a5932f9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:39.805743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a3e69-ed39-4ba6-ad7e-709a5932f9ff None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:39.824588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 315/641] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:39.825104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a3e69-ed39-4ba6-ad7e-709a5932f9ff None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:39.875822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b9791-c766-4fd5-ad73-609aad2b1c91 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:39.912544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d62a6-e1e4-45b2-a970-75d73a869b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:39.913376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d62a6-e1e4-45b2-a970-75d73a869b07 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.913751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d62a6-e1e4-45b2-a970-75d73a869b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.914112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d62a6-e1e4-45b2-a970-75d73a869b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.925063 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d62a6-e1e4-45b2-a970-75d73a869b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2f4d62a6-e1e4-45b2-a970-75d73a869b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:39.930278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:39.931409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 327/642] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:39.932317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d62a6-e1e4-45b2-a970-75d73a869b07 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:39.943994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a3e69-ed39-4ba6-ad7e-709a5932f9ff None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:39.953023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:39.978599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22348f4-98cc-421f-9c8f-d075a55ed564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:39.979518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22348f4-98cc-421f-9c8f-d075a55ed564 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:39.979518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22348f4-98cc-421f-9c8f-d075a55ed564 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:39.981090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22348f4-98cc-421f-9c8f-d075a55ed564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:39.987784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22348f4-98cc-421f-9c8f-d075a55ed564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:39.989401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22348f4-98cc-421f-9c8f-d075a55ed564 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b22348f4-98cc-421f-9c8f-d075a55ed564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:40.002328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:40.003320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:40.004853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:40.004853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:40.004853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:40.004853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:40.004853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:40.004853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:40.004853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:40.004853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:40.004853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 316/643] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:40.004853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22348f4-98cc-421f-9c8f-d075a55ed564 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:40.045574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:40.053224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d62a6-e1e4-45b2-a970-75d73a869b07 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:40.090835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566c862-7004-4114-b6f1-b8a9cabb3d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:40.091618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566c862-7004-4114-b6f1-b8a9cabb3d8a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:40.091900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566c862-7004-4114-b6f1-b8a9cabb3d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:40.092442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566c862-7004-4114-b6f1-b8a9cabb3d8a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:40.100545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566c862-7004-4114-b6f1-b8a9cabb3d8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:40.102001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566c862-7004-4114-b6f1-b8a9cabb3d8a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:40.107577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22348f4-98cc-421f-9c8f-d075a55ed564 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0566c862-7004-4114-b6f1-b8a9cabb3d8a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:40.114452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:40.115703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:40.116708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 328/644] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:40.117396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566c862-7004-4114-b6f1-b8a9cabb3d8a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:40.150915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd303e-1877-4955-a98d-dbdc993697e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:40.151543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd303e-1877-4955-a98d-dbdc993697e2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:40.151826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd303e-1877-4955-a98d-dbdc993697e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:40.152102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd303e-1877-4955-a98d-dbdc993697e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:40.162668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd303e-1877-4955-a98d-dbdc993697e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-79bd303e-1877-4955-a98d-dbdc993697e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:40.167871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:40.168950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:40.170072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:40.173791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 317/645] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:40.174612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd303e-1877-4955-a98d-dbdc993697e2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:40.204884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:40.232246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566c862-7004-4114-b6f1-b8a9cabb3d8a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:40.269745 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb34a8-44be-45b7-bf4f-c72e38b96477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:40.270416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb34a8-44be-45b7-bf4f-c72e38b96477 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:40.271247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb34a8-44be-45b7-bf4f-c72e38b96477 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:40.271521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb34a8-44be-45b7-bf4f-c72e38b96477 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:40.272191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb34a8-44be-45b7-bf4f-c72e38b96477 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:40.272504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb34a8-44be-45b7-bf4f-c72e38b96477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:40.273882 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb34a8-44be-45b7-bf4f-c72e38b96477 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:40.283085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd303e-1877-4955-a98d-dbdc993697e2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:40.287325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 329/646] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:40.288077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb34a8-44be-45b7-bf4f-c72e38b96477 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:40.311719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:40.322506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977ee1-292e-455c-8e56-05e021d2dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:40.323204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977ee1-292e-455c-8e56-05e021d2dd0b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:40.323650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977ee1-292e-455c-8e56-05e021d2dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:40.323923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977ee1-292e-455c-8e56-05e021d2dd0b None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:40.324917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977ee1-292e-455c-8e56-05e021d2dd0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:40.325234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977ee1-292e-455c-8e56-05e021d2dd0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:40.326691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977ee1-292e-455c-8e56-05e021d2dd0b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:40.345567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 318/647] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:40.345567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977ee1-292e-455c-8e56-05e021d2dd0b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:40.400638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb34a8-44be-45b7-bf4f-c72e38b96477 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:40.437341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:40.443300 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adee11-4c88-46ea-9fcd-ae1d214f3246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:40.443988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adee11-4c88-46ea-9fcd-ae1d214f3246 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:40.444274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adee11-4c88-46ea-9fcd-ae1d214f3246 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:40.444540 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adee11-4c88-46ea-9fcd-ae1d214f3246 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:40.445260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adee11-4c88-46ea-9fcd-ae1d214f3246 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:40.445559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adee11-4c88-46ea-9fcd-ae1d214f3246 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:40.447060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adee11-4c88-46ea-9fcd-ae1d214f3246 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:40.450966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977ee1-292e-455c-8e56-05e021d2dd0b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:40.471249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 330/648] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Oct 4 08:21:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:40.476340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adee11-4c88-46ea-9fcd-ae1d214f3246 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:40.489831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034923bd-2c21-4bbd-a21b-cb7c123d4a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:40.490477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034923bd-2c21-4bbd-a21b-cb7c123d4a0a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:40.490888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034923bd-2c21-4bbd-a21b-cb7c123d4a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:40.491220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034923bd-2c21-4bbd-a21b-cb7c123d4a0a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:40.491945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034923bd-2c21-4bbd-a21b-cb7c123d4a0a None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:40.492311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034923bd-2c21-4bbd-a21b-cb7c123d4a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:40.493726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034923bd-2c21-4bbd-a21b-cb7c123d4a0a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:40.507152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 319/649] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:40.507152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034923bd-2c21-4bbd-a21b-cb7c123d4a0a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:40.561415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:40.586311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adee11-4c88-46ea-9fcd-ae1d214f3246 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:40.607289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034923bd-2c21-4bbd-a21b-cb7c123d4a0a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:40.621034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c02c-6f23-4f19-818d-2a86d0480835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:40.621676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c02c-6f23-4f19-818d-2a86d0480835 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:40.622319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c02c-6f23-4f19-818d-2a86d0480835 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:40.622479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c02c-6f23-4f19-818d-2a86d0480835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:40.634735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908c02c-6f23-4f19-818d-2a86d0480835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:40.636199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908c02c-6f23-4f19-818d-2a86d0480835 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:40.644006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e42ac-8c8d-4cd1-8e94-93ae38c695af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:40.644832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e42ac-8c8d-4cd1-8e94-93ae38c695af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:40.645112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e42ac-8c8d-4cd1-8e94-93ae38c695af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:40.645485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e42ac-8c8d-4cd1-8e94-93ae38c695af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:40.646397 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e42ac-8c8d-4cd1-8e94-93ae38c695af None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=2c6603b106fa4db58f3d1b5099606ffa) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:40.646726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e42ac-8c8d-4cd1-8e94-93ae38c695af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:40.648164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e42ac-8c8d-4cd1-8e94-93ae38c695af None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:40.663048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 320/650] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:40 2022] GET /identity/v3/role_assignments?user.id=2c6603b106fa4db58f3d1b5099606ffa&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:40.663048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e42ac-8c8d-4cd1-8e94-93ae38c695af None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d908c02c-6f23-4f19-818d-2a86d0480835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:40.663305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:40.664199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:40.665067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:40.665067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:40.665067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:40.665067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 331/651] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:40.665067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c02c-6f23-4f19-818d-2a86d0480835 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:40.681501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:40.792847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e42ac-8c8d-4cd1-8e94-93ae38c695af None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:40.794033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c02c-6f23-4f19-818d-2a86d0480835 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:40.828252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:40.842223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa9546-baf0-4bb1-b6c9-25321bfc96fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:40.843284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa9546-baf0-4bb1-b6c9-25321bfc96fc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:40.843744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa9546-baf0-4bb1-b6c9-25321bfc96fc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:40.844189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa9546-baf0-4bb1-b6c9-25321bfc96fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:40.845049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd618b-04fa-4b06-bffd-81e80aedef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:40.845882 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd618b-04fa-4b06-bffd-81e80aedef88 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:40.846231 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd618b-04fa-4b06-bffd-81e80aedef88 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:40.846573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd618b-04fa-4b06-bffd-81e80aedef88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:40.863751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd618b-04fa-4b06-bffd-81e80aedef88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:40.865821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd618b-04fa-4b06-bffd-81e80aedef88 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-15bd618b-04fa-4b06-bffd-81e80aedef88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:40.882037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:40.883056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:40.884627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:40.884627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:40.884627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:40.884627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 332/652] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:40.884627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd618b-04fa-4b06-bffd-81e80aedef88 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:40.932125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa9546-baf0-4bb1-b6c9-25321bfc96fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:40.933697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa9546-baf0-4bb1-b6c9-25321bfc96fc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:40.952781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:41.028348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd618b-04fa-4b06-bffd-81e80aedef88 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:41.054506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 321/653] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:41.055848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa9546-baf0-4bb1-b6c9-25321bfc96fc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:41.069715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9479950-d7c7-4ba6-bebd-864be292594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:41.070342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9479950-d7c7-4ba6-bebd-864be292594e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.070621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9479950-d7c7-4ba6-bebd-864be292594e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.070950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9479950-d7c7-4ba6-bebd-864be292594e None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.072431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9479950-d7c7-4ba6-bebd-864be292594e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:41.072761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9479950-d7c7-4ba6-bebd-864be292594e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:41.074212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9479950-d7c7-4ba6-bebd-864be292594e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:41.091362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 333/654] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:41.092252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9479950-d7c7-4ba6-bebd-864be292594e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:41.148730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:41.187061 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa9546-baf0-4bb1-b6c9-25321bfc96fc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:41.202372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:41.212342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9479950-d7c7-4ba6-bebd-864be292594e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:41.223811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f43ee-5147-4dc0-b8d9-b54335b356dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:41.224419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f43ee-5147-4dc0-b8d9-b54335b356dd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.224695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f43ee-5147-4dc0-b8d9-b54335b356dd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.224961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f43ee-5147-4dc0-b8d9-b54335b356dd None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.225590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f43ee-5147-4dc0-b8d9-b54335b356dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:41.226013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f43ee-5147-4dc0-b8d9-b54335b356dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:41.227534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f43ee-5147-4dc0-b8d9-b54335b356dd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:41.244840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 322/655] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:41.244840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f43ee-5147-4dc0-b8d9-b54335b356dd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:41.251568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13c3b8-884b-4ebf-9d87-494874752319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:41.252202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13c3b8-884b-4ebf-9d87-494874752319 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.252483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13c3b8-884b-4ebf-9d87-494874752319 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.252754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13c3b8-884b-4ebf-9d87-494874752319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.263735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13c3b8-884b-4ebf-9d87-494874752319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:41.265201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13c3b8-884b-4ebf-9d87-494874752319 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2a13c3b8-884b-4ebf-9d87-494874752319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:41.280759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:41.281724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:41.282633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:41.282633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:41.282633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:41.282633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 334/656] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:41.283163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202bda0-6c48-4a1b-b671-85eb9b0f4bd3 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.283314 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202bda0-6c48-4a1b-b671-85eb9b0f4bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.283590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202bda0-6c48-4a1b-b671-85eb9b0f4bd3 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.284803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 335/657] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:41.289689 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202bda0-6c48-4a1b-b671-85eb9b0f4bd3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:41.352365 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f43ee-5147-4dc0-b8d9-b54335b356dd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:41.384875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:41.387260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420821-ef6c-4173-aa23-053099ff49b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:41.388616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420821-ef6c-4173-aa23-053099ff49b3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.388616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420821-ef6c-4173-aa23-053099ff49b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.388888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420821-ef6c-4173-aa23-053099ff49b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.396916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202bda0-6c48-4a1b-b671-85eb9b0f4bd3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:41.398028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420821-ef6c-4173-aa23-053099ff49b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:41.399928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420821-ef6c-4173-aa23-053099ff49b3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e0420821-ef6c-4173-aa23-053099ff49b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:41.412953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:41.413910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:41.415063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:41.415063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:41.415063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:41.415063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:41.415063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:41.415063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:41.415063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:41.415063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:41.415063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:21:41.415063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:41.417152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 323/658] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:41.418083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420821-ef6c-4173-aa23-053099ff49b3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:41.435633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92f64-7547-4463-80e3-388dd49bfe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:41.436260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92f64-7547-4463-80e3-388dd49bfe80 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.436537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92f64-7547-4463-80e3-388dd49bfe80 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.436805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92f64-7547-4463-80e3-388dd49bfe80 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.444983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b92f64-7547-4463-80e3-388dd49bfe80 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:41.446414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b92f64-7547-4463-80e3-388dd49bfe80 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:41.457483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-49b92f64-7547-4463-80e3-388dd49bfe80 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:41.462574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:41.463849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:41.464778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 336/659] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:41.465387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36478ccf-d8e4-4015-b08e-ec7516863564 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.465387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36478ccf-d8e4-4015-b08e-ec7516863564 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.465653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36478ccf-d8e4-4015-b08e-ec7516863564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.487300 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-36478ccf-d8e4-4015-b08e-ec7516863564 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:41.488479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-36478ccf-d8e4-4015-b08e-ec7516863564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:41.529910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420821-ef6c-4173-aa23-053099ff49b3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:41.562927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcb6d2-4fee-4aa3-828c-94dbf39d1ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:41.563668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcb6d2-4fee-4aa3-828c-94dbf39d1ddc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.564048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcb6d2-4fee-4aa3-828c-94dbf39d1ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.564421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcb6d2-4fee-4aa3-828c-94dbf39d1ddc None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.565151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcb6d2-4fee-4aa3-828c-94dbf39d1ddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:41.565553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcb6d2-4fee-4aa3-828c-94dbf39d1ddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:41.568135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 337/660] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:41.568252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcb6d2-4fee-4aa3-828c-94dbf39d1ddc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:41.568697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36478ccf-d8e4-4015-b08e-ec7516863564 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:41.581938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 324/661] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:41.583714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcb6d2-4fee-4aa3-828c-94dbf39d1ddc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:41.666523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:41.688271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36478ccf-d8e4-4015-b08e-ec7516863564 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:41.689620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcb6d2-4fee-4aa3-828c-94dbf39d1ddc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:41.699227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:41.730973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62fb37-2f5b-4960-ae0d-244d5c2cc9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:41.731895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62fb37-2f5b-4960-ae0d-244d5c2cc9af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.732409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62fb37-2f5b-4960-ae0d-244d5c2cc9af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.732915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62fb37-2f5b-4960-ae0d-244d5c2cc9af None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.734120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62fb37-2f5b-4960-ae0d-244d5c2cc9af None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:41.734341 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169b2d3-bc5a-4ffe-896b-434d1004de7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:41.734789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62fb37-2f5b-4960-ae0d-244d5c2cc9af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:41.735161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b2d3-bc5a-4ffe-896b-434d1004de7a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.735533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b2d3-bc5a-4ffe-896b-434d1004de7a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.735901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b2d3-bc5a-4ffe-896b-434d1004de7a None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.736723 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169b2d3-bc5a-4ffe-896b-434d1004de7a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:41.736981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62fb37-2f5b-4960-ae0d-244d5c2cc9af None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:41.737222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169b2d3-bc5a-4ffe-896b-434d1004de7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:41.739038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169b2d3-bc5a-4ffe-896b-434d1004de7a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:41.756805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 325/662] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Oct 4 08:21:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:41.757882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62fb37-2f5b-4960-ae0d-244d5c2cc9af None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:41.764107 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 338/663] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Oct 4 08:21:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:41.765016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169b2d3-bc5a-4ffe-896b-434d1004de7a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:41.867650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62fb37-2f5b-4960-ae0d-244d5c2cc9af None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:41.889513 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169b2d3-bc5a-4ffe-896b-434d1004de7a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:41.902424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cfc3f-b279-4440-97b1-f62a5d1ae47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:41.903075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cfc3f-b279-4440-97b1-f62a5d1ae47b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.903359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cfc3f-b279-4440-97b1-f62a5d1ae47b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.903633 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cfc3f-b279-4440-97b1-f62a5d1ae47b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.910419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cfc3f-b279-4440-97b1-f62a5d1ae47b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:41.912121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cfc3f-b279-4440-97b1-f62a5d1ae47b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b15cfc3f-b279-4440-97b1-f62a5d1ae47b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:41.923377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:41.924276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:41.930745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:41.930745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:41.930745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:41.930745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:41.930745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:41.930745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:41.930745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:41.930745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:41.930745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 326/664] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:41.931250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cb1c2-b84c-44ba-9fa4-3e8cb5e46a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:41.931342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cfc3f-b279-4440-97b1-f62a5d1ae47b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:41.931414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cb1c2-b84c-44ba-9fa4-3e8cb5e46a7d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:41.931414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cb1c2-b84c-44ba-9fa4-3e8cb5e46a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:41.931414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cb1c2-b84c-44ba-9fa4-3e8cb5e46a7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:41.940901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:41.948499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:42.007000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cb1c2-b84c-44ba-9fa4-3e8cb5e46a7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:42.008544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cb1c2-b84c-44ba-9fa4-3e8cb5e46a7d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:42.043734 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cfc3f-b279-4440-97b1-f62a5d1ae47b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:42.079093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec5256-6d2b-4602-a871-602936820cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:42.079705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5256-6d2b-4602-a871-602936820cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:42.079980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5256-6d2b-4602-a871-602936820cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:42.080248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5256-6d2b-4602-a871-602936820cb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:42.111333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 339/665] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:42.112195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cb1c2-b84c-44ba-9fa4-3e8cb5e46a7d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:42.154198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:42.162902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec5256-6d2b-4602-a871-602936820cb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:42.164366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec5256-6d2b-4602-a871-602936820cb5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:42.178322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:42.219091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cb1c2-b84c-44ba-9fa4-3e8cb5e46a7d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:42.261592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912e3b6-7f54-4bbf-8bf6-5967fcca1453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:42.262212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e3b6-7f54-4bbf-8bf6-5967fcca1453 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:42.262495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e3b6-7f54-4bbf-8bf6-5967fcca1453 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:42.262775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e3b6-7f54-4bbf-8bf6-5967fcca1453 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:42.274431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 327/666] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:42.274431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec5256-6d2b-4602-a871-602936820cb5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:42.279660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912e3b6-7f54-4bbf-8bf6-5967fcca1453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2912e3b6-7f54-4bbf-8bf6-5967fcca1453 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:42.284830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:42.285989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 340/667] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:42.286943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912e3b6-7f54-4bbf-8bf6-5967fcca1453 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:42.374893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec5256-6d2b-4602-a871-602936820cb5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:42.389713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:42.395363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:42.399551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912e3b6-7f54-4bbf-8bf6-5967fcca1453 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:42.416688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda76c87-619d-464e-a66f-800b891d501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:42.417465 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda76c87-619d-464e-a66f-800b891d501e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:42.417747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda76c87-619d-464e-a66f-800b891d501e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:42.418289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda76c87-619d-464e-a66f-800b891d501e None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:42.419018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda76c87-619d-464e-a66f-800b891d501e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:42.419331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda76c87-619d-464e-a66f-800b891d501e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:42.421215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda76c87-619d-464e-a66f-800b891d501e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:42.434560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc9fcb-f217-473b-b9aa-759502205dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:42.435216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9fcb-f217-473b-b9aa-759502205dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:42.435496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9fcb-f217-473b-b9aa-759502205dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:42.435766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9fcb-f217-473b-b9aa-759502205dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:42.438817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 328/668] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:42.439703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda76c87-619d-464e-a66f-800b891d501e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:42.449594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc9fcb-f217-473b-b9aa-759502205dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:42.451089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc9fcb-f217-473b-b9aa-759502205dd4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-19bc9fcb-f217-473b-b9aa-759502205dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:42.470209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:42.476342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:42.477297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:42.477297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:42.477297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:42.477297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 341/669] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:42.477297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc9fcb-f217-473b-b9aa-759502205dd4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:42.555617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda76c87-619d-464e-a66f-800b891d501e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:42.589807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc9fcb-f217-473b-b9aa-759502205dd4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:42.590365 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19920-a307-43b7-a191-953ac1cfd167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:42.591040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19920-a307-43b7-a191-953ac1cfd167 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:42.591320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19920-a307-43b7-a191-953ac1cfd167 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:42.591593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19920-a307-43b7-a191-953ac1cfd167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:42.606205 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e19920-a307-43b7-a191-953ac1cfd167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:42.607791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e19920-a307-43b7-a191-953ac1cfd167 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-99e19920-a307-43b7-a191-953ac1cfd167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:42.624088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:42.625115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:42.626034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:42.626034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:42.626034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:42.626034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 329/670] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:42.626034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19920-a307-43b7-a191-953ac1cfd167 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:42.644038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b2b5d-5997-48bf-ad20-442f650ca8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:42.644653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b2b5d-5997-48bf-ad20-442f650ca8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:42.644939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b2b5d-5997-48bf-ad20-442f650ca8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:42.645213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b2b5d-5997-48bf-ad20-442f650ca8d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:42.645940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b2b5d-5997-48bf-ad20-442f650ca8d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:42.646240 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b2b5d-5997-48bf-ad20-442f650ca8d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:42.647711 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b2b5d-5997-48bf-ad20-442f650ca8d4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:42.656312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 342/671] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:42.656689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:42.657547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b2b5d-5997-48bf-ad20-442f650ca8d4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:42.675904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:42.741049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19920-a307-43b7-a191-953ac1cfd167 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:42.771586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b2b5d-5997-48bf-ad20-442f650ca8d4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:42.776110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7198bf-6c9a-4dae-97cc-f9deaa8c9067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:42.776723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7198bf-6c9a-4dae-97cc-f9deaa8c9067 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:42.777001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7198bf-6c9a-4dae-97cc-f9deaa8c9067 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:42.777271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7198bf-6c9a-4dae-97cc-f9deaa8c9067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:42.777990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7198bf-6c9a-4dae-97cc-f9deaa8c9067 None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=7b2324f9166d4c2dac76f08b03991769) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:42.778639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7198bf-6c9a-4dae-97cc-f9deaa8c9067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:42.779773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7198bf-6c9a-4dae-97cc-f9deaa8c9067 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:42.794710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 330/672] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:42 2022] GET /identity/v3/role_assignments?user.id=7b2324f9166d4c2dac76f08b03991769&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:42.794710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7198bf-6c9a-4dae-97cc-f9deaa8c9067 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:42.817009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dde052-1093-4ec2-bf0b-4b405d40ae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:42.817869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dde052-1093-4ec2-bf0b-4b405d40ae17 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:42.818329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dde052-1093-4ec2-bf0b-4b405d40ae17 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:42.818694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dde052-1093-4ec2-bf0b-4b405d40ae17 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:42.819447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dde052-1093-4ec2-bf0b-4b405d40ae17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:42.819829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dde052-1093-4ec2-bf0b-4b405d40ae17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:42.821323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dde052-1093-4ec2-bf0b-4b405d40ae17 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:42.836180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 343/673] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:42.837226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dde052-1093-4ec2-bf0b-4b405d40ae17 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:42.898147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:42.918885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7198bf-6c9a-4dae-97cc-f9deaa8c9067 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:42.947304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:42.977408 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc35c9-35ab-4ad6-b5f7-e2c3b210d060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:42.978402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc35c9-35ab-4ad6-b5f7-e2c3b210d060 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:42.979013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc35c9-35ab-4ad6-b5f7-e2c3b210d060 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:42.979511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc35c9-35ab-4ad6-b5f7-e2c3b210d060 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:42.980632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc35c9-35ab-4ad6-b5f7-e2c3b210d060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:42.981200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc35c9-35ab-4ad6-b5f7-e2c3b210d060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:42.982713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dde052-1093-4ec2-bf0b-4b405d40ae17 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:42.983617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc35c9-35ab-4ad6-b5f7-e2c3b210d060 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:43.007208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 331/674] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:43.008202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc35c9-35ab-4ad6-b5f7-e2c3b210d060 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:43.027533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68ab88-686f-41eb-93ce-d359e3af6239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:43.028267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68ab88-686f-41eb-93ce-d359e3af6239 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.028615 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68ab88-686f-41eb-93ce-d359e3af6239 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.028964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68ab88-686f-41eb-93ce-d359e3af6239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.040361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68ab88-686f-41eb-93ce-d359e3af6239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:43.041801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68ab88-686f-41eb-93ce-d359e3af6239 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-bf68ab88-686f-41eb-93ce-d359e3af6239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:43.058394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:43.059415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:43.060954 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:43.060954 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:43.060954 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:43.060954 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 344/675] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:43.060954 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50772d-b241-4a7a-ad2d-f4ac92df0e40 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.061321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50772d-b241-4a7a-ad2d-f4ac92df0e40 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.061321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50772d-b241-4a7a-ad2d-f4ac92df0e40 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.062828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 345/676] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:43.063342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50772d-b241-4a7a-ad2d-f4ac92df0e40 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:43.129833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc35c9-35ab-4ad6-b5f7-e2c3b210d060 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:43.164365 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0126c39-ea08-4f17-a46d-a64a3348bb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:43.164993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0126c39-ea08-4f17-a46d-a64a3348bb53 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.165268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0126c39-ea08-4f17-a46d-a64a3348bb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.165538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0126c39-ea08-4f17-a46d-a64a3348bb53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.172369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0126c39-ea08-4f17-a46d-a64a3348bb53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:43.173800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0126c39-ea08-4f17-a46d-a64a3348bb53 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:43.175227 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50772d-b241-4a7a-ad2d-f4ac92df0e40 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c0126c39-ea08-4f17-a46d-a64a3348bb53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:43.185704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:43.186643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:43.187618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:43.187618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:43.187618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:43.187618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:43.187618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:43.187618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:43.187618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:43.187618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:43.187618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 332/677] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:43.187618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0126c39-ea08-4f17-a46d-a64a3348bb53 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:43.199820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:43.209030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:43.219241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6a1a7-fa7a-4cf1-8a0e-2f989a5ff139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:43.219893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a1a7-fa7a-4cf1-8a0e-2f989a5ff139 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.220173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a1a7-fa7a-4cf1-8a0e-2f989a5ff139 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.220444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a1a7-fa7a-4cf1-8a0e-2f989a5ff139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.229559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6a1a7-fa7a-4cf1-8a0e-2f989a5ff139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:43.231056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6a1a7-fa7a-4cf1-8a0e-2f989a5ff139 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-54d6a1a7-fa7a-4cf1-8a0e-2f989a5ff139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:43.242951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:43.244073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:43.244998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:43.244998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:43.244998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:43.244998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:43.244998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:43.244998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:43.244998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:43.244998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:43.244998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 346/678] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:43.245508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe3c7-7f99-4caa-ab5d-3a4434e6f6c3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.245788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe3c7-7f99-4caa-ab5d-3a4434e6f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.246058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe3c7-7f99-4caa-ab5d-3a4434e6f6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.265178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e7ffe3c7-7f99-4caa-ab5d-3a4434e6f6c3 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:43.266733 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e7ffe3c7-7f99-4caa-ab5d-3a4434e6f6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:43.303419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0126c39-ea08-4f17-a46d-a64a3348bb53 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:43.338731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18b4cc-8818-4e83-9ef3-f04cb9a1d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:43.339518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b4cc-8818-4e83-9ef3-f04cb9a1d28d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.339897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b4cc-8818-4e83-9ef3-f04cb9a1d28d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.340174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b4cc-8818-4e83-9ef3-f04cb9a1d28d None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.340817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18b4cc-8818-4e83-9ef3-f04cb9a1d28d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:43.341124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18b4cc-8818-4e83-9ef3-f04cb9a1d28d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:43.342595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18b4cc-8818-4e83-9ef3-f04cb9a1d28d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:43.343345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 347/679] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:43.344120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe3c7-7f99-4caa-ab5d-3a4434e6f6c3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:43.366981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 333/680] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:43.371175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18b4cc-8818-4e83-9ef3-f04cb9a1d28d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:43.456190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe3c7-7f99-4caa-ab5d-3a4434e6f6c3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:43.466902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:43.480949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:43.506025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275165-645d-4fa3-a431-d8461741595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:43.507016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275165-645d-4fa3-a431-d8461741595e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.507370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275165-645d-4fa3-a431-d8461741595e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.507707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275165-645d-4fa3-a431-d8461741595e None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.508491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275165-645d-4fa3-a431-d8461741595e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:43.508870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275165-645d-4fa3-a431-d8461741595e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:43.509696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18b4cc-8818-4e83-9ef3-f04cb9a1d28d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:43.510454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275165-645d-4fa3-a431-d8461741595e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:43.529799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 348/681] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:43.529799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275165-645d-4fa3-a431-d8461741595e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:43.554268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c228ab-2d88-4871-99eb-c18ff2afc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:43.555179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c228ab-2d88-4871-99eb-c18ff2afc343 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.555691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c228ab-2d88-4871-99eb-c18ff2afc343 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.556648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c228ab-2d88-4871-99eb-c18ff2afc343 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.557558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c228ab-2d88-4871-99eb-c18ff2afc343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:43.558069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c228ab-2d88-4871-99eb-c18ff2afc343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:43.559894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c228ab-2d88-4871-99eb-c18ff2afc343 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:43.577756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 334/682] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:43.579170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c228ab-2d88-4871-99eb-c18ff2afc343 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:43.642361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275165-645d-4fa3-a431-d8461741595e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:43.680932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4b045-5781-49b7-82af-118ff3ef1cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:43.681818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4b045-5781-49b7-82af-118ff3ef1cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.682101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4b045-5781-49b7-82af-118ff3ef1cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.682373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4b045-5781-49b7-82af-118ff3ef1cc5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.686750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c228ab-2d88-4871-99eb-c18ff2afc343 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:43.689892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4b045-5781-49b7-82af-118ff3ef1cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:43.691361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4b045-5781-49b7-82af-118ff3ef1cc5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-55e4b045-5781-49b7-82af-118ff3ef1cc5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:43.703082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:43.704111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 349/683] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:43.705059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4b045-5781-49b7-82af-118ff3ef1cc5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:43.721997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:43.730997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467509f-6cbf-4afc-847c-502946bc7fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:43.731684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467509f-6cbf-4afc-847c-502946bc7fac None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.732036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467509f-6cbf-4afc-847c-502946bc7fac None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.732374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467509f-6cbf-4afc-847c-502946bc7fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.733170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467509f-6cbf-4afc-847c-502946bc7fac None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=9a186bffa7854d34b91edfa4eb4b2498) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:43.733560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467509f-6cbf-4afc-847c-502946bc7fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:43.735128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467509f-6cbf-4afc-847c-502946bc7fac None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:43.741088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 335/684] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/role_assignments?user.id=9a186bffa7854d34b91edfa4eb4b2498&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:43.741934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467509f-6cbf-4afc-847c-502946bc7fac None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:43.759591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:43.841017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4b045-5781-49b7-82af-118ff3ef1cc5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:43.888069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b59f0-361c-4a03-bbe9-0d2047c1963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:43.888934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b59f0-361c-4a03-bbe9-0d2047c1963d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.889416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b59f0-361c-4a03-bbe9-0d2047c1963d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.889764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b59f0-361c-4a03-bbe9-0d2047c1963d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.890601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b59f0-361c-4a03-bbe9-0d2047c1963d None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=53db39d8c5d1459294b0376d052a9495) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:43.891126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b59f0-361c-4a03-bbe9-0d2047c1963d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:43.893410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b59f0-361c-4a03-bbe9-0d2047c1963d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:43.894859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467509f-6cbf-4afc-847c-502946bc7fac None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:43.901467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 350/685] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/role_assignments?user.id=53db39d8c5d1459294b0376d052a9495&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:43.902417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b59f0-361c-4a03-bbe9-0d2047c1963d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:43.942036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75755178-6067-4b72-8e9d-45a1acaac38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:43.943579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75755178-6067-4b72-8e9d-45a1acaac38a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:43.944477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75755178-6067-4b72-8e9d-45a1acaac38a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:43.945288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75755178-6067-4b72-8e9d-45a1acaac38a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:43.967546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75755178-6067-4b72-8e9d-45a1acaac38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-75755178-6067-4b72-8e9d-45a1acaac38a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:43.975578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:43.976841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:43.977908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:43.978637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 336/686] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:43.986984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75755178-6067-4b72-8e9d-45a1acaac38a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:44.053851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:44.054769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:44.058186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b59f0-361c-4a03-bbe9-0d2047c1963d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:44.100496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db3d0f-4a02-4139-8bef-9bb18dfe7665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:44.101460 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db3d0f-4a02-4139-8bef-9bb18dfe7665 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:44.101981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db3d0f-4a02-4139-8bef-9bb18dfe7665 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:44.102423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db3d0f-4a02-4139-8bef-9bb18dfe7665 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:44.103451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db3d0f-4a02-4139-8bef-9bb18dfe7665 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:44.103955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db3d0f-4a02-4139-8bef-9bb18dfe7665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:44.105828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db3d0f-4a02-4139-8bef-9bb18dfe7665 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:44.107970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75755178-6067-4b72-8e9d-45a1acaac38a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:44.128370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 351/687] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:44.143226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db3d0f-4a02-4139-8bef-9bb18dfe7665 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:44.154090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1180b5-5e9c-4796-9732-af6b6aea1a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:44.154836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1180b5-5e9c-4796-9732-af6b6aea1a06 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:44.155041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1180b5-5e9c-4796-9732-af6b6aea1a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:44.155630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1180b5-5e9c-4796-9732-af6b6aea1a06 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:44.156311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1180b5-5e9c-4796-9732-af6b6aea1a06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:44.156625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1180b5-5e9c-4796-9732-af6b6aea1a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:44.158017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1180b5-5e9c-4796-9732-af6b6aea1a06 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:44.173581 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 337/688] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:44.180205 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1180b5-5e9c-4796-9732-af6b6aea1a06 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:44.283709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db3d0f-4a02-4139-8bef-9bb18dfe7665 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:44.326429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9cf72-314f-4d48-91e6-c30b0441f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:44.327103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9cf72-314f-4d48-91e6-c30b0441f96e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:44.327386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9cf72-314f-4d48-91e6-c30b0441f96e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:44.327661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9cf72-314f-4d48-91e6-c30b0441f96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:44.329180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1180b5-5e9c-4796-9732-af6b6aea1a06 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:44.349391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:44.362317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:44.373552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3f109-f1d0-405b-9206-c80a81a36170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:44.374187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f109-f1d0-405b-9206-c80a81a36170 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:44.374468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f109-f1d0-405b-9206-c80a81a36170 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:44.374770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f109-f1d0-405b-9206-c80a81a36170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:44.386867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3f109-f1d0-405b-9206-c80a81a36170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:44.388447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3f109-f1d0-405b-9206-c80a81a36170 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-93e3f109-f1d0-405b-9206-c80a81a36170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:44.407502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:44.408498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:44.409385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:44.409385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:44.409385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:44.409385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 338/689] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:44.410002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3f109-f1d0-405b-9206-c80a81a36170 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:44.427677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9cf72-314f-4d48-91e6-c30b0441f96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:44.429147 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9cf72-314f-4d48-91e6-c30b0441f96e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:44.597964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 352/690] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:44.604779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9cf72-314f-4d48-91e6-c30b0441f96e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:44.622055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3f109-f1d0-405b-9206-c80a81a36170 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:44.705358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167d3a4-5110-4784-8191-6de5d3b80316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:44.706284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167d3a4-5110-4784-8191-6de5d3b80316 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:44.706920 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167d3a4-5110-4784-8191-6de5d3b80316 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:44.707213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167d3a4-5110-4784-8191-6de5d3b80316 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:44.708869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167d3a4-5110-4784-8191-6de5d3b80316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:44.709560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167d3a4-5110-4784-8191-6de5d3b80316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:44.710998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167d3a4-5110-4784-8191-6de5d3b80316 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:44.719678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:44.744923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 339/691] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:44.751794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167d3a4-5110-4784-8191-6de5d3b80316 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:44.760357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9cf72-314f-4d48-91e6-c30b0441f96e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:44.810370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:44.833795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f4f2-6f1d-4a00-a39d-4279812706ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:44.834875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f4f2-6f1d-4a00-a39d-4279812706ec None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:44.835366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f4f2-6f1d-4a00-a39d-4279812706ec None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:44.835845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f4f2-6f1d-4a00-a39d-4279812706ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:44.856681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f4f2-6f1d-4a00-a39d-4279812706ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:44.858045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f4f2-6f1d-4a00-a39d-4279812706ec None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-1a77f4f2-6f1d-4a00-a39d-4279812706ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:44.898388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:44.899650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:44.901069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:44.901069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:44.901069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:44.901069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 353/692] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:44.905156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f4f2-6f1d-4a00-a39d-4279812706ec None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:44.909536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167d3a4-5110-4784-8191-6de5d3b80316 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:44.949627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31218f79-5d1c-44ef-8339-801d1b0c79d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:44.950761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31218f79-5d1c-44ef-8339-801d1b0c79d8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:44.953868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31218f79-5d1c-44ef-8339-801d1b0c79d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:44.955838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31218f79-5d1c-44ef-8339-801d1b0c79d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:44.970477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31218f79-5d1c-44ef-8339-801d1b0c79d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:44.972547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31218f79-5d1c-44ef-8339-801d1b0c79d8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-31218f79-5d1c-44ef-8339-801d1b0c79d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:44.986649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:44.987678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:44.988617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:44.988617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:44.988617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:44.988617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:44.988617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:44.988617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:44.988617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:44.988617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:44.988617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:44.988617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:44.991852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 340/693] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Oct 4 08:21:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:45.000738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31218f79-5d1c-44ef-8339-801d1b0c79d8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:45.090357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f4f2-6f1d-4a00-a39d-4279812706ec None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:45.107323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:45.127319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226a04-e1d2-4da7-b74a-93c3edf78abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:45.127939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226a04-e1d2-4da7-b74a-93c3edf78abf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:45.128221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226a04-e1d2-4da7-b74a-93c3edf78abf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:45.128604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226a04-e1d2-4da7-b74a-93c3edf78abf None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:45.129136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226a04-e1d2-4da7-b74a-93c3edf78abf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:45.129440 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226a04-e1d2-4da7-b74a-93c3edf78abf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:45.132581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226a04-e1d2-4da7-b74a-93c3edf78abf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:45.144636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 354/694] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:45.153327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226a04-e1d2-4da7-b74a-93c3edf78abf None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:45.190998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:45.209619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31218f79-5d1c-44ef-8339-801d1b0c79d8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:45.269341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b1298-61d9-4ef8-9c62-2287f3edc9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:45.269979 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b1298-61d9-4ef8-9c62-2287f3edc9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:45.270344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b1298-61d9-4ef8-9c62-2287f3edc9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:45.270623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b1298-61d9-4ef8-9c62-2287f3edc9d8 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:45.271583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b1298-61d9-4ef8-9c62-2287f3edc9d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:45.271927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b1298-61d9-4ef8-9c62-2287f3edc9d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:45.273505 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b1298-61d9-4ef8-9c62-2287f3edc9d8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:45.298773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 341/695] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Oct 4 08:21:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:45.300514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4dd38-e783-47d7-9cab-96a0686ec592 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:45.301058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4dd38-e783-47d7-9cab-96a0686ec592 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:45.301333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4dd38-e783-47d7-9cab-96a0686ec592 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:45.303205 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 342/696] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:45.304034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4dd38-e783-47d7-9cab-96a0686ec592 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:45.309517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226a04-e1d2-4da7-b74a-93c3edf78abf None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:45.347660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416284d-d381-493f-a711-30e60a2b2ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:45.348839 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416284d-d381-493f-a711-30e60a2b2ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:45.349291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416284d-d381-493f-a711-30e60a2b2ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:45.349567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416284d-d381-493f-a711-30e60a2b2ef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:45.356438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416284d-d381-493f-a711-30e60a2b2ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:45.357885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416284d-d381-493f-a711-30e60a2b2ef6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b416284d-d381-493f-a711-30e60a2b2ef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:45.370719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:45.371635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 355/697] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d439b-206d-4b20-b6b6-3933be027a6c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:45.373693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d439b-206d-4b20-b6b6-3933be027a6c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:45.375153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d439b-206d-4b20-b6b6-3933be027a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:45.395791 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-247d439b-206d-4b20-b6b6-3933be027a6c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:45.397069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-247d439b-206d-4b20-b6b6-3933be027a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:45.418064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4dd38-e783-47d7-9cab-96a0686ec592 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:45.423985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:45.472782 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a611-f722-4cff-a2d9-59cd2269ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:45.473480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a611-f722-4cff-a2d9-59cd2269ec60 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:45.473762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a611-f722-4cff-a2d9-59cd2269ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:45.474034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a611-f722-4cff-a2d9-59cd2269ec60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:45.485115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 356/698] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:45.486785 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d439b-206d-4b20-b6b6-3933be027a6c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:45.498848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:45.594866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d439b-206d-4b20-b6b6-3933be027a6c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:45.603966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42a611-f722-4cff-a2d9-59cd2269ec60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:45.605731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42a611-f722-4cff-a2d9-59cd2269ec60 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:45.644586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12836f-8eb4-4d8c-a76c-47f498927eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:45.645579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12836f-8eb4-4d8c-a76c-47f498927eee None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:45.645863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12836f-8eb4-4d8c-a76c-47f498927eee None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:45.646137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12836f-8eb4-4d8c-a76c-47f498927eee None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:45.650038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12836f-8eb4-4d8c-a76c-47f498927eee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:45.650363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12836f-8eb4-4d8c-a76c-47f498927eee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:45.653522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12836f-8eb4-4d8c-a76c-47f498927eee None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:45.682768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 357/699] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:45.688144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12836f-8eb4-4d8c-a76c-47f498927eee None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:45.714065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:45.799272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 343/700] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:45.809173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12836f-8eb4-4d8c-a76c-47f498927eee None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:45.811640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a611-f722-4cff-a2d9-59cd2269ec60 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:45.853769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dfb94-8490-4ade-8617-ceac4ad7e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:45.854373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dfb94-8490-4ade-8617-ceac4ad7e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:45.854644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dfb94-8490-4ade-8617-ceac4ad7e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:45.854930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dfb94-8490-4ade-8617-ceac4ad7e5e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:45.855651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dfb94-8490-4ade-8617-ceac4ad7e5e8 None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=ce739a6448604eae823fd285a0164b47) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:45.855957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dfb94-8490-4ade-8617-ceac4ad7e5e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:45.857373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dfb94-8490-4ade-8617-ceac4ad7e5e8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:45.878325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 358/701] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:45 2022] GET /identity/v3/role_assignments?user.id=ce739a6448604eae823fd285a0164b47&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:45.882517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:45.975957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a611-f722-4cff-a2d9-59cd2269ec60 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:45.981889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dfb94-8490-4ade-8617-ceac4ad7e5e8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:46.023742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4a191-35f7-4c23-8e48-36e195ca225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:46.024399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4a191-35f7-4c23-8e48-36e195ca225c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.024687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4a191-35f7-4c23-8e48-36e195ca225c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.024956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4a191-35f7-4c23-8e48-36e195ca225c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.046418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4a191-35f7-4c23-8e48-36e195ca225c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:46.047975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4a191-35f7-4c23-8e48-36e195ca225c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-aca4a191-35f7-4c23-8e48-36e195ca225c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:46.065208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:46.066272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:46.067888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:46.067888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:46.067888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:46.067888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 344/702] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:46.079759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4a191-35f7-4c23-8e48-36e195ca225c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:46.147179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:46.175953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dfb94-8490-4ade-8617-ceac4ad7e5e8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:46.222304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:46.226340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c70940-ae55-4b0e-8343-9c09139143c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:46.227207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70940-ae55-4b0e-8343-9c09139143c4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.227490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70940-ae55-4b0e-8343-9c09139143c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.227764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70940-ae55-4b0e-8343-9c09139143c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.228728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4a191-35f7-4c23-8e48-36e195ca225c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:46.241720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c70940-ae55-4b0e-8343-9c09139143c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:46.243753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c70940-ae55-4b0e-8343-9c09139143c4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-17c70940-ae55-4b0e-8343-9c09139143c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:46.262981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:46.264023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:46.264921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:46.264921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:46.264921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:46.264921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 359/703] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:46.267940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ed43c-1a15-4ba4-aa53-0d34ba5968cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:46.268706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ed43c-1a15-4ba4-aa53-0d34ba5968cf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.269079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ed43c-1a15-4ba4-aa53-0d34ba5968cf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.269443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ed43c-1a15-4ba4-aa53-0d34ba5968cf None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.269927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c70940-ae55-4b0e-8343-9c09139143c4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:46.270838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ed43c-1a15-4ba4-aa53-0d34ba5968cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:46.271246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ed43c-1a15-4ba4-aa53-0d34ba5968cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:46.272710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ed43c-1a15-4ba4-aa53-0d34ba5968cf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:46.286197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 345/704] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:46.291703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ed43c-1a15-4ba4-aa53-0d34ba5968cf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:46.411406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c70940-ae55-4b0e-8343-9c09139143c4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:46.416311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ed43c-1a15-4ba4-aa53-0d34ba5968cf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:46.455955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45460db9-a38e-4e34-a743-ecbe100cbee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:46.456606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45460db9-a38e-4e34-a743-ecbe100cbee6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.456887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45460db9-a38e-4e34-a743-ecbe100cbee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.457163 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45460db9-a38e-4e34-a743-ecbe100cbee6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.470739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be64e-70bf-4a33-beb2-8c1363db647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:46.471606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be64e-70bf-4a33-beb2-8c1363db647c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.472080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be64e-70bf-4a33-beb2-8c1363db647c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.472561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be64e-70bf-4a33-beb2-8c1363db647c None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.473690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be64e-70bf-4a33-beb2-8c1363db647c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:46.474372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be64e-70bf-4a33-beb2-8c1363db647c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:46.475385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45460db9-a38e-4e34-a743-ecbe100cbee6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:46.476312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be64e-70bf-4a33-beb2-8c1363db647c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:46.477036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45460db9-a38e-4e34-a743-ecbe100cbee6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:46.479471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-45460db9-a38e-4e34-a743-ecbe100cbee6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:46.493690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:46.494639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:46.495582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:46.495582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:46.495582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:46.495582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:46.495582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:46.495582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:46.495582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:46.495582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:46.495582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 346/705] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:46.496896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979f8e6-17ac-41e8-8f67-a67ad5178f08 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.497047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 360/706] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:46.497369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979f8e6-17ac-41e8-8f67-a67ad5178f08 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.497786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979f8e6-17ac-41e8-8f67-a67ad5178f08 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.502730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be64e-70bf-4a33-beb2-8c1363db647c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:46.506008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 347/707] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:46.506008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979f8e6-17ac-41e8-8f67-a67ad5178f08 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:46.528201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:46.624393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be64e-70bf-4a33-beb2-8c1363db647c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:46.648073 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979f8e6-17ac-41e8-8f67-a67ad5178f08 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:46.674474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcda611-83ff-4ff5-bc70-c4c823b616ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:46.675132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcda611-83ff-4ff5-bc70-c4c823b616ba None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.675807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcda611-83ff-4ff5-bc70-c4c823b616ba None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.676143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcda611-83ff-4ff5-bc70-c4c823b616ba None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.678290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcda611-83ff-4ff5-bc70-c4c823b616ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:46.679013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcda611-83ff-4ff5-bc70-c4c823b616ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:46.680762 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcda611-83ff-4ff5-bc70-c4c823b616ba None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:46.693791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4f2af-3639-493e-96c9-5b69cbe968e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:46.694406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f2af-3639-493e-96c9-5b69cbe968e2 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.694703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f2af-3639-493e-96c9-5b69cbe968e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.695012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f2af-3639-493e-96c9-5b69cbe968e2 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.695665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4f2af-3639-493e-96c9-5b69cbe968e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:46.695857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 361/708] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:46.697182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4f2af-3639-493e-96c9-5b69cbe968e2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:46.697356 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f460-3823-47bb-8c29-f7c96d0fd259 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.697665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f460-3823-47bb-8c29-f7c96d0fd259 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.698006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f460-3823-47bb-8c29-f7c96d0fd259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.720653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-eb73f460-3823-47bb-8c29-f7c96d0fd259 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:46.722106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-eb73f460-3823-47bb-8c29-f7c96d0fd259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:46.726758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 348/709] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:21:46 2022] POST /identity/v3/users => generated 254 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:21:46.727801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4f2af-3639-493e-96c9-5b69cbe968e2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:46.815956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:46.821802 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:46.850777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 362/710] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:46.852438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dc432-c3ff-441f-a01d-e56d01d448b3 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.853741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dc432-c3ff-441f-a01d-e56d01d448b3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.854985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dc432-c3ff-441f-a01d-e56d01d448b3 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.859039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 363/711] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:46.866768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4f2af-3639-493e-96c9-5b69cbe968e2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:46.868470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb393-37ff-4299-a2d6-c60a7c6b7854 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.868960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb393-37ff-4299-a2d6-c60a7c6b7854 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.869440 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb393-37ff-4299-a2d6-c60a7c6b7854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.892669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c7ecb393-37ff-4299-a2d6-c60a7c6b7854 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:46.894578 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c7ecb393-37ff-4299-a2d6-c60a7c6b7854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:46.937012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30559e0e-c65c-4c5b-88ae-85bb8c8a1ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:46.937627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30559e0e-c65c-4c5b-88ae-85bb8c8a1ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:46.937910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30559e0e-c65c-4c5b-88ae-85bb8c8a1ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:46.938187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30559e0e-c65c-4c5b-88ae-85bb8c8a1ee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:46.938953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30559e0e-c65c-4c5b-88ae-85bb8c8a1ee0 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=2c6603b106fa4db58f3d1b5099606ffa) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:46.939267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30559e0e-c65c-4c5b-88ae-85bb8c8a1ee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:46.940936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30559e0e-c65c-4c5b-88ae-85bb8c8a1ee0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:46.947764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 349/712] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:46 2022] GET /identity/v3/role_assignments?user.id=2c6603b106fa4db58f3d1b5099606ffa&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:46.983296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 364/713] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:47.146742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30559e0e-c65c-4c5b-88ae-85bb8c8a1ee0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:47.256285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30559e0e-c65c-4c5b-88ae-85bb8c8a1ee0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:47.270990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb393-37ff-4299-a2d6-c60a7c6b7854 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:47.292959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18c286-f80a-4544-960f-25fdb04079c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:47.293596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18c286-f80a-4544-960f-25fdb04079c3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:47.293877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18c286-f80a-4544-960f-25fdb04079c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:47.294151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18c286-f80a-4544-960f-25fdb04079c3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:47.294770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18c286-f80a-4544-960f-25fdb04079c3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:47.296442 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18c286-f80a-4544-960f-25fdb04079c3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:47.300910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1c18c286-f80a-4544-960f-25fdb04079c3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:47.309977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:47.311060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:47.311987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 350/714] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:47 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:47.318234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18c286-f80a-4544-960f-25fdb04079c3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:47.463497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb393-37ff-4299-a2d6-c60a7c6b7854 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:47.485471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18c286-f80a-4544-960f-25fdb04079c3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:47.498284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:47.533439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53e16a-69bc-4130-afc2-d08719952520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:47.533989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e16a-69bc-4130-afc2-d08719952520 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:47.534268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e16a-69bc-4130-afc2-d08719952520 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:47.534543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e16a-69bc-4130-afc2-d08719952520 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:47.535173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53e16a-69bc-4130-afc2-d08719952520 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:47.537091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53e16a-69bc-4130-afc2-d08719952520 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:47.538596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19360325-537b-4cee-9b9f-2e846f13b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:47.539385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19360325-537b-4cee-9b9f-2e846f13b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:47.539668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19360325-537b-4cee-9b9f-2e846f13b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:47.539941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19360325-537b-4cee-9b9f-2e846f13b8b9 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:47.540855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19360325-537b-4cee-9b9f-2e846f13b8b9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:47.541161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19360325-537b-4cee-9b9f-2e846f13b8b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:47.543144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19360325-537b-4cee-9b9f-2e846f13b8b9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9b53e16a-69bc-4130-afc2-d08719952520 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:47.555372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:47.556419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:47.557257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 365/715] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Oct 4 08:21:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:47.560628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 351/716] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:21:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:47.565871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19360325-537b-4cee-9b9f-2e846f13b8b9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:47.568156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53e16a-69bc-4130-afc2-d08719952520 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:47.646511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:47.693383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19360325-537b-4cee-9b9f-2e846f13b8b9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:47.732027 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894063f1-0e64-4641-9e48-be8781a431e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:47.732638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894063f1-0e64-4641-9e48-be8781a431e2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:47.732923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894063f1-0e64-4641-9e48-be8781a431e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:47.733201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894063f1-0e64-4641-9e48-be8781a431e2 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:47.733971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894063f1-0e64-4641-9e48-be8781a431e2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:47.734284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894063f1-0e64-4641-9e48-be8781a431e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:47.735956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894063f1-0e64-4641-9e48-be8781a431e2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:47.743359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 352/717] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:21:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:47.796636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53e16a-69bc-4130-afc2-d08719952520 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:47.854018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4195b38-0378-42f9-abfa-c9aeb66c5f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:47.854656 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195b38-0378-42f9-abfa-c9aeb66c5f1d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:47.854966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195b38-0378-42f9-abfa-c9aeb66c5f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:47.855240 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195b38-0378-42f9-abfa-c9aeb66c5f1d None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:47.855889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4195b38-0378-42f9-abfa-c9aeb66c5f1d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:47.856193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4195b38-0378-42f9-abfa-c9aeb66c5f1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:47.857606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4195b38-0378-42f9-abfa-c9aeb66c5f1d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:47.863186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 366/718] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Oct 4 08:21:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:47.869011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894063f1-0e64-4641-9e48-be8781a431e2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:47.988678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894063f1-0e64-4641-9e48-be8781a431e2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:48.019414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:48.030260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace87355-98c7-49e5-ae33-bb898ac12784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:48.030912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87355-98c7-49e5-ae33-bb898ac12784 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:48.031197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87355-98c7-49e5-ae33-bb898ac12784 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:48.031472 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87355-98c7-49e5-ae33-bb898ac12784 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:48.032121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace87355-98c7-49e5-ae33-bb898ac12784 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:48.032427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace87355-98c7-49e5-ae33-bb898ac12784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:48.033807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace87355-98c7-49e5-ae33-bb898ac12784 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:48.039554 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 353/719] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Oct 4 08:21:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:48.744116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ab688-fdb3-4adf-8d47-b5d3272492f5 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:48.744486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ab688-fdb3-4adf-8d47-b5d3272492f5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:48.744603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ab688-fdb3-4adf-8d47-b5d3272492f5 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:48.746192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 367/720] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:48.751092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe283552-6d82-4873-9cc1-a101532e257a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:48.751382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe283552-6d82-4873-9cc1-a101532e257a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:48.751660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe283552-6d82-4873-9cc1-a101532e257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:48.779687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fe283552-6d82-4873-9cc1-a101532e257a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:48.780951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fe283552-6d82-4873-9cc1-a101532e257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:48.871461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 354/721] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:49.350427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ab688-fdb3-4adf-8d47-b5d3272492f5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:49.422526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:49.484741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ab688-fdb3-4adf-8d47-b5d3272492f5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:49.490950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2bd56-b92a-4ca5-95a8-c2009094b3c7 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:49.491589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2bd56-b92a-4ca5-95a8-c2009094b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:49.492058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2bd56-b92a-4ca5-95a8-c2009094b3c7 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:49.494000 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 355/722] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:49.499553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a17d2-1179-4ce7-bdd0-06deecafedc5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:49.500214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a17d2-1179-4ce7-bdd0-06deecafedc5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:49.500684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a17d2-1179-4ce7-bdd0-06deecafedc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:49.520267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9b8a17d2-1179-4ce7-bdd0-06deecafedc5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:49.521905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9b8a17d2-1179-4ce7-bdd0-06deecafedc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:49.544077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511fce-6590-4293-a112-cb1931172cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:49.544727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511fce-6590-4293-a112-cb1931172cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:49.545011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511fce-6590-4293-a112-cb1931172cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:49.545289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511fce-6590-4293-a112-cb1931172cf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:49.571293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6511fce-6590-4293-a112-cb1931172cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-c6511fce-6590-4293-a112-cb1931172cf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:49.576683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:49.577608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:49.578467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 368/723] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:49.583918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511fce-6590-4293-a112-cb1931172cf9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:49.599823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 356/724] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:49.655129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcf318-938c-4904-a56f-0e0a9b6acfca None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:49.655423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcf318-938c-4904-a56f-0e0a9b6acfca None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:49.655621 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcf318-938c-4904-a56f-0e0a9b6acfca None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:49.657233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 357/725] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:21:49.663621 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880891-a53a-4b66-873d-f93f423f4c73 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:49.663907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880891-a53a-4b66-873d-f93f423f4c73 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:49.664188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880891-a53a-4b66-873d-f93f423f4c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:49.684656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-40880891-a53a-4b66-873d-f93f423f4c73 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:49.685856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-40880891-a53a-4b66-873d-f93f423f4c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:49.771552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511fce-6590-4293-a112-cb1931172cf9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:49.775046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:49.789419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:49.815401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 358/726] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:21:49.838088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b41c78-d5f0-433b-869a-6c216f34f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:49.838795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b41c78-d5f0-433b-869a-6c216f34f8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:49.839084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b41c78-d5f0-433b-869a-6c216f34f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:49.839360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b41c78-d5f0-433b-869a-6c216f34f8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:49.840025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b41c78-d5f0-433b-869a-6c216f34f8c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:49.840332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b41c78-d5f0-433b-869a-6c216f34f8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:49.841697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b41c78-d5f0-433b-869a-6c216f34f8c1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:49.849946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 369/727] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:49.855855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40880891-a53a-4b66-873d-f93f423f4c73 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:49.883845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b41c78-d5f0-433b-869a-6c216f34f8c1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:50.055631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40880891-a53a-4b66-873d-f93f423f4c73 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.058834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b41c78-d5f0-433b-869a-6c216f34f8c1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.119411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b76462-aa44-49f7-b95f-7dc4f1030ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:50.120101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b76462-aa44-49f7-b95f-7dc4f1030ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.120387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b76462-aa44-49f7-b95f-7dc4f1030ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.120660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b76462-aa44-49f7-b95f-7dc4f1030ae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.123302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6e82f-44fd-4109-8317-6e7a93598af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:50.123989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6e82f-44fd-4109-8317-6e7a93598af3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.124272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6e82f-44fd-4109-8317-6e7a93598af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.124548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6e82f-44fd-4109-8317-6e7a93598af3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.139979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b76462-aa44-49f7-b95f-7dc4f1030ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:50.141085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6e82f-44fd-4109-8317-6e7a93598af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:50.142611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6e82f-44fd-4109-8317-6e7a93598af3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-77b76462-aa44-49f7-b95f-7dc4f1030ae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:50.146051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:50.147133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:50.148023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:50.150784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 370/728] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:50.151621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b76462-aa44-49f7-b95f-7dc4f1030ae9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-25a6e82f-44fd-4109-8317-6e7a93598af3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:50.163961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:50.165034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:50.165962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:50.165962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:50.165962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:50.167596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 359/729] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:50.172577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6e82f-44fd-4109-8317-6e7a93598af3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:50.190726 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:50.215553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:50.271486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b76462-aa44-49f7-b95f-7dc4f1030ae9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.309327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5506c64-fd97-4087-94a1-25383a6e7f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:50.310282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6e82f-44fd-4109-8317-6e7a93598af3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.310522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5506c64-fd97-4087-94a1-25383a6e7f01 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.311025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5506c64-fd97-4087-94a1-25383a6e7f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.311501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5506c64-fd97-4087-94a1-25383a6e7f01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.328286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5506c64-fd97-4087-94a1-25383a6e7f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-f5506c64-fd97-4087-94a1-25383a6e7f01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:50.335093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:50.336057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:50.336913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:50.341196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 371/730] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:50.342041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5506c64-fd97-4087-94a1-25383a6e7f01 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:50.353398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e26600-3e35-444a-8429-ca576207ad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:50.354344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26600-3e35-444a-8429-ca576207ad4b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.354880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26600-3e35-444a-8429-ca576207ad4b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.355361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26600-3e35-444a-8429-ca576207ad4b None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.356227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e26600-3e35-444a-8429-ca576207ad4b None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:50.356736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e26600-3e35-444a-8429-ca576207ad4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:50.358472 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e26600-3e35-444a-8429-ca576207ad4b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:50.368157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 360/731] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:50.369336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e26600-3e35-444a-8429-ca576207ad4b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:50.463643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:50.485230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:50.486527 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5506c64-fd97-4087-94a1-25383a6e7f01 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.493991 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e26600-3e35-444a-8429-ca576207ad4b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.530868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e59c40-1c3b-47f4-8d9f-8fe4eb2ae572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:50.531459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e59c40-1c3b-47f4-8d9f-8fe4eb2ae572 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.531776 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e59c40-1c3b-47f4-8d9f-8fe4eb2ae572 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.531999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e59c40-1c3b-47f4-8d9f-8fe4eb2ae572 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.532662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e59c40-1c3b-47f4-8d9f-8fe4eb2ae572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:50.532942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e59c40-1c3b-47f4-8d9f-8fe4eb2ae572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:50.533937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad40f-fd4f-42ed-ba63-4ccf4f0f23fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:50.534454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e59c40-1c3b-47f4-8d9f-8fe4eb2ae572 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:50.535023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad40f-fd4f-42ed-ba63-4ccf4f0f23fc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.535547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad40f-fd4f-42ed-ba63-4ccf4f0f23fc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.536112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad40f-fd4f-42ed-ba63-4ccf4f0f23fc None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.537081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ad40f-fd4f-42ed-ba63-4ccf4f0f23fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:50.537588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ad40f-fd4f-42ed-ba63-4ccf4f0f23fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:50.539361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ad40f-fd4f-42ed-ba63-4ccf4f0f23fc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:50.552449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 372/732] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:50.552449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e59c40-1c3b-47f4-8d9f-8fe4eb2ae572 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:50.555358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 361/733] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:50.556420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad40f-fd4f-42ed-ba63-4ccf4f0f23fc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:50.668392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad40f-fd4f-42ed-ba63-4ccf4f0f23fc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.671333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e59c40-1c3b-47f4-8d9f-8fe4eb2ae572 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.704870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64772fbc-1f2b-4de3-a967-25694b624a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:50.705508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64772fbc-1f2b-4de3-a967-25694b624a03 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.705792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64772fbc-1f2b-4de3-a967-25694b624a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.705924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c0413-8b9d-4415-ad18-f3c5d40f6af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:50.706104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64772fbc-1f2b-4de3-a967-25694b624a03 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.706468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c0413-8b9d-4415-ad18-f3c5d40f6af8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.706771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c0413-8b9d-4415-ad18-f3c5d40f6af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.707040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c0413-8b9d-4415-ad18-f3c5d40f6af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.714088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64772fbc-1f2b-4de3-a967-25694b624a03 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:50.715625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64772fbc-1f2b-4de3-a967-25694b624a03 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:50.718444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c0413-8b9d-4415-ad18-f3c5d40f6af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:50.719829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c0413-8b9d-4415-ad18-f3c5d40f6af8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:50.726995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-64772fbc-1f2b-4de3-a967-25694b624a03 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:50.728692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:50.729613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:50.730566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:50.730566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:50.730566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:50.730566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:50.730566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:50.730566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:50.730566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:50.730566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:50.730566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:21:50.730566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:50.735200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 362/734] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:50.735894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64772fbc-1f2b-4de3-a967-25694b624a03 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-f28c0413-8b9d-4415-ad18-f3c5d40f6af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:50.736301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:50.737412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:50.738912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:50.738912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:50.738912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:50.745853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 373/735] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:50.745853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bde94-7ba2-4ce7-9ae7-500b2af2f244 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.745853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bde94-7ba2-4ce7-9ae7-500b2af2f244 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.745853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bde94-7ba2-4ce7-9ae7-500b2af2f244 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.745853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 374/736] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:50.748467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bde94-7ba2-4ce7-9ae7-500b2af2f244 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:50.757457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:50.838199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64772fbc-1f2b-4de3-a967-25694b624a03 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.849154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bde94-7ba2-4ce7-9ae7-500b2af2f244 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.870605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e667-74c1-4635-a840-063c082c858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:50.871259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e667-74c1-4635-a840-063c082c858a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.871546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e667-74c1-4635-a840-063c082c858a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.871822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e667-74c1-4635-a840-063c082c858a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.882204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57d6b-be31-4b6e-b8ff-075a8bf56f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:50.882851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57d6b-be31-4b6e-b8ff-075a8bf56f2a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.883126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57d6b-be31-4b6e-b8ff-075a8bf56f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.883335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162e667-74c1-4635-a840-063c082c858a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:50.883429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57d6b-be31-4b6e-b8ff-075a8bf56f2a None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.884103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e57d6b-be31-4b6e-b8ff-075a8bf56f2a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:50.884407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e57d6b-be31-4b6e-b8ff-075a8bf56f2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:50.884767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162e667-74c1-4635-a840-063c082c858a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:50.885827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e57d6b-be31-4b6e-b8ff-075a8bf56f2a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d162e667-74c1-4635-a840-063c082c858a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:50.899066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:50.900169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:50.901210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:50.901210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:50.901210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:50.901210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 363/737] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:50.901210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e667-74c1-4635-a840-063c082c858a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:50.905929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 375/738] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Oct 4 08:21:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:50.907163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea3621-1250-4736-a8ca-3dd21ec98011 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.907448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea3621-1250-4736-a8ca-3dd21ec98011 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.907719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea3621-1250-4736-a8ca-3dd21ec98011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.925768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fbea3621-1250-4736-a8ca-3dd21ec98011 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:50.927446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fbea3621-1250-4736-a8ca-3dd21ec98011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:50.967606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:50.976103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:50.994480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 376/739] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:50.996266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156b426-eb61-4258-b521-76ed4835a877 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:50.996752 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156b426-eb61-4258-b521-76ed4835a877 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:50.997336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156b426-eb61-4258-b521-76ed4835a877 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:50.998533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e667-74c1-4635-a840-063c082c858a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:50.998945 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 377/740] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:50.999660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156b426-eb61-4258-b521-76ed4835a877 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:51.033706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22610957-97ba-423d-afd2-256b41513427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:51.034309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22610957-97ba-423d-afd2-256b41513427 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.034637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22610957-97ba-423d-afd2-256b41513427 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.034897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22610957-97ba-423d-afd2-256b41513427 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.035551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22610957-97ba-423d-afd2-256b41513427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:51.036092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22610957-97ba-423d-afd2-256b41513427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:51.037208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22610957-97ba-423d-afd2-256b41513427 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:51.049479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 364/741] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:51.051904 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22610957-97ba-423d-afd2-256b41513427 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:51.115162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156b426-eb61-4258-b521-76ed4835a877 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:51.151775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8be8d5-45ba-4755-9b12-8353f118b17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:51.152381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be8d5-45ba-4755-9b12-8353f118b17d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.152664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be8d5-45ba-4755-9b12-8353f118b17d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.152940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be8d5-45ba-4755-9b12-8353f118b17d None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.153590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8be8d5-45ba-4755-9b12-8353f118b17d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:51.153903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8be8d5-45ba-4755-9b12-8353f118b17d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:51.155342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8be8d5-45ba-4755-9b12-8353f118b17d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:51.159024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22610957-97ba-423d-afd2-256b41513427 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:51.167783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 378/742] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:51.168980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288e761-e78a-4f77-a9de-2d4fee4a60c9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.169267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288e761-e78a-4f77-a9de-2d4fee4a60c9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.169540 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288e761-e78a-4f77-a9de-2d4fee4a60c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.188833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a288e761-e78a-4f77-a9de-2d4fee4a60c9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:51.190032 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a288e761-e78a-4f77-a9de-2d4fee4a60c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:51.194717 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:51.201102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9df409-f52d-4ce5-8610-a14fe4eb4374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:51.201712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df409-f52d-4ce5-8610-a14fe4eb4374 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.201996 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df409-f52d-4ce5-8610-a14fe4eb4374 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.202271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df409-f52d-4ce5-8610-a14fe4eb4374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.234486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:51.266837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 379/743] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:21:51.266837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288e761-e78a-4f77-a9de-2d4fee4a60c9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:51.283289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9df409-f52d-4ce5-8610-a14fe4eb4374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:51.284859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9df409-f52d-4ce5-8610-a14fe4eb4374 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:51.372617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288e761-e78a-4f77-a9de-2d4fee4a60c9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:51.385618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 365/744] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:21:51.387345 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9df409-f52d-4ce5-8610-a14fe4eb4374 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:51.416901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7725998-8000-4aea-ac83-0907b4f676fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:51.417528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725998-8000-4aea-ac83-0907b4f676fa None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.417808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725998-8000-4aea-ac83-0907b4f676fa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.418085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725998-8000-4aea-ac83-0907b4f676fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.420850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:51.427510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7725998-8000-4aea-ac83-0907b4f676fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:51.429123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7725998-8000-4aea-ac83-0907b4f676fa None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-e7725998-8000-4aea-ac83-0907b4f676fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:51.444113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:51.445079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 380/745] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Oct 4 08:21:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:51.446029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7725998-8000-4aea-ac83-0907b4f676fa None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:51.492955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:51.508356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9df409-f52d-4ce5-8610-a14fe4eb4374 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:51.542736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bfd2e-a647-4de7-b748-5f5d19e4c955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:51.543360 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bfd2e-a647-4de7-b748-5f5d19e4c955 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.543637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bfd2e-a647-4de7-b748-5f5d19e4c955 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.543913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bfd2e-a647-4de7-b748-5f5d19e4c955 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.550879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bfd2e-a647-4de7-b748-5f5d19e4c955 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:51.552893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bfd2e-a647-4de7-b748-5f5d19e4c955 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:51.562952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7725998-8000-4aea-ac83-0907b4f676fa None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fe7bfd2e-a647-4de7-b748-5f5d19e4c955 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:51.563926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:51.564966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 366/746] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Oct 4 08:21:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:51.565962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bfd2e-a647-4de7-b748-5f5d19e4c955 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:51.599177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56680dd-cdd1-4ee8-8e97-84ffc5109ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:51.599785 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56680dd-cdd1-4ee8-8e97-84ffc5109ac0 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.600061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56680dd-cdd1-4ee8-8e97-84ffc5109ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.600333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56680dd-cdd1-4ee8-8e97-84ffc5109ac0 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.600977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56680dd-cdd1-4ee8-8e97-84ffc5109ac0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:51.602333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56680dd-cdd1-4ee8-8e97-84ffc5109ac0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:51.622787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 381/747] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:21:51 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:21:51.622787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56680dd-cdd1-4ee8-8e97-84ffc5109ac0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:51.659229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:51.670377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bfd2e-a647-4de7-b748-5f5d19e4c955 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:51.716232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76986f0c-0c27-4dd2-b975-916a785f880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:51.717006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76986f0c-0c27-4dd2-b975-916a785f880e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.717530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76986f0c-0c27-4dd2-b975-916a785f880e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.718043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76986f0c-0c27-4dd2-b975-916a785f880e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.731238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76986f0c-0c27-4dd2-b975-916a785f880e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:51.732715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76986f0c-0c27-4dd2-b975-916a785f880e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:51.735257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:51.744156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56680dd-cdd1-4ee8-8e97-84ffc5109ac0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-76986f0c-0c27-4dd2-b975-916a785f880e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:51.749826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:51.756660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:51.757807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:51.757807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:51.757807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:51.757807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 367/748] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:51.757807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76986f0c-0c27-4dd2-b975-916a785f880e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:51.791129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802a4a8-6df6-4914-a661-5aa05b6d8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:51.791844 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802a4a8-6df6-4914-a661-5aa05b6d8639 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.792207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802a4a8-6df6-4914-a661-5aa05b6d8639 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.792536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802a4a8-6df6-4914-a661-5aa05b6d8639 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.793349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802a4a8-6df6-4914-a661-5aa05b6d8639 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:51.793659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802a4a8-6df6-4914-a661-5aa05b6d8639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:51.795204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802a4a8-6df6-4914-a661-5aa05b6d8639 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:51.818047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 382/749] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Oct 4 08:21:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:51.819218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802a4a8-6df6-4914-a661-5aa05b6d8639 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:51.867874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76986f0c-0c27-4dd2-b975-916a785f880e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:51.901997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ac6b2-28af-479e-bea1-75a8294d7e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:51.902785 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ac6b2-28af-479e-bea1-75a8294d7e80 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.903170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ac6b2-28af-479e-bea1-75a8294d7e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.903547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ac6b2-28af-479e-bea1-75a8294d7e80 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.904300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ac6b2-28af-479e-bea1-75a8294d7e80 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:51.905811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ac6b2-28af-479e-bea1-75a8294d7e80 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:51.917509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:51.930843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 368/750] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:21:51 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:21:51.931047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802a4a8-6df6-4914-a661-5aa05b6d8639 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:51.931135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ac6b2-28af-479e-bea1-75a8294d7e80 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:51.982702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9373-c4e0-4f03-91d1-c62ece517b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:51.983673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9373-c4e0-4f03-91d1-c62ece517b77 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:51.984123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9373-c4e0-4f03-91d1-c62ece517b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:51.984599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9373-c4e0-4f03-91d1-c62ece517b77 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:51.985686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f9373-c4e0-4f03-91d1-c62ece517b77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:51.986168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f9373-c4e0-4f03-91d1-c62ece517b77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:51.987990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f9373-c4e0-4f03-91d1-c62ece517b77 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:52.010597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 383/751] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Oct 4 08:21:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:52.011743 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9373-c4e0-4f03-91d1-c62ece517b77 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:52.024575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:52.068638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ac6b2-28af-479e-bea1-75a8294d7e80 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:52.118925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83357030-c781-4d85-8340-3ed6b092830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:52.120532 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357030-c781-4d85-8340-3ed6b092830f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:52.120821 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357030-c781-4d85-8340-3ed6b092830f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:52.121095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357030-c781-4d85-8340-3ed6b092830f None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:52.121755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83357030-c781-4d85-8340-3ed6b092830f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:52.122062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83357030-c781-4d85-8340-3ed6b092830f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:52.123511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83357030-c781-4d85-8340-3ed6b092830f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:52.132914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9373-c4e0-4f03-91d1-c62ece517b77 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:52.148862 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 369/752] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:52.150070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83357030-c781-4d85-8340-3ed6b092830f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:52.185657 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63193204-2350-4226-a53c-ceaa7d6ae12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:52.186276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193204-2350-4226-a53c-ceaa7d6ae12a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:52.186558 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193204-2350-4226-a53c-ceaa7d6ae12a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:52.186860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193204-2350-4226-a53c-ceaa7d6ae12a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:52.218093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:52.266612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83357030-c781-4d85-8340-3ed6b092830f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:52.270609 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63193204-2350-4226-a53c-ceaa7d6ae12a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:52.272182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63193204-2350-4226-a53c-ceaa7d6ae12a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:52.284677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:52.307708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3068c1-efd2-4052-872f-1329634afb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:52.309265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3068c1-efd2-4052-872f-1329634afb4c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:52.309695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3068c1-efd2-4052-872f-1329634afb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:52.310136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3068c1-efd2-4052-872f-1329634afb4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:52.326123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3068c1-efd2-4052-872f-1329634afb4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:52.327640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3068c1-efd2-4052-872f-1329634afb4c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6e3068c1-efd2-4052-872f-1329634afb4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:52.346859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:52.347934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:52.348857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:52.348857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:52.348857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:52.348857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 370/753] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:52.348857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3068c1-efd2-4052-872f-1329634afb4c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:52.410421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 384/754] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:21:52.412451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63193204-2350-4226-a53c-ceaa7d6ae12a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:52.461807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3068c1-efd2-4052-872f-1329634afb4c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:52.475498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:52.502170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3b72f-f682-4b50-8326-dc8184d48f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:52.503294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3b72f-f682-4b50-8326-dc8184d48f39 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:52.503410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3b72f-f682-4b50-8326-dc8184d48f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:52.503603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3b72f-f682-4b50-8326-dc8184d48f39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:52.512811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3b72f-f682-4b50-8326-dc8184d48f39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:52.514275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3b72f-f682-4b50-8326-dc8184d48f39 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:52.525132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63193204-2350-4226-a53c-ceaa7d6ae12a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-4ba3b72f-f682-4b50-8326-dc8184d48f39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:52.527149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:52.528023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:52.528914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:52.528914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:52.528914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:52.528914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:52.528914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:52.528914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:52.528914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:52.528914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:52.528914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 371/755] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:52.528914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3b72f-f682-4b50-8326-dc8184d48f39 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:52.547091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:52.569860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb78cb-fb88-4da1-bf1d-edabea97ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:52.570888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb78cb-fb88-4da1-bf1d-edabea97ac1b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:52.571373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb78cb-fb88-4da1-bf1d-edabea97ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:52.571913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb78cb-fb88-4da1-bf1d-edabea97ac1b None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:52.572761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb78cb-fb88-4da1-bf1d-edabea97ac1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:52.573264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb78cb-fb88-4da1-bf1d-edabea97ac1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:52.574965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb78cb-fb88-4da1-bf1d-edabea97ac1b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:52.592492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 385/756] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:52.593672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb78cb-fb88-4da1-bf1d-edabea97ac1b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:52.638914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3b72f-f682-4b50-8326-dc8184d48f39 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:52.675067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145509f1-8936-4c4f-a953-db3f60614c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:52.675958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145509f1-8936-4c4f-a953-db3f60614c02 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:52.676808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145509f1-8936-4c4f-a953-db3f60614c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:52.677143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145509f1-8936-4c4f-a953-db3f60614c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:52.688258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145509f1-8936-4c4f-a953-db3f60614c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:52.689796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145509f1-8936-4c4f-a953-db3f60614c02 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:52.701508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb78cb-fb88-4da1-bf1d-edabea97ac1b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-145509f1-8936-4c4f-a953-db3f60614c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:52.705837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:52.706798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:52.708321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:52.708321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:52.708321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:52.712732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 372/757] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:52.713676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145509f1-8936-4c4f-a953-db3f60614c02 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:52.750702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:52.750898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167bd25-df0c-41d3-b048-58a197c64826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:52.750898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167bd25-df0c-41d3-b048-58a197c64826 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:52.750898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167bd25-df0c-41d3-b048-58a197c64826 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:52.750898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167bd25-df0c-41d3-b048-58a197c64826 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:52.751195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167bd25-df0c-41d3-b048-58a197c64826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:52.751463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167bd25-df0c-41d3-b048-58a197c64826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:52.753079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167bd25-df0c-41d3-b048-58a197c64826 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:52.773391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 386/758] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:52.774249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167bd25-df0c-41d3-b048-58a197c64826 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:52.811860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:52.833858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145509f1-8936-4c4f-a953-db3f60614c02 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:52.869386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92aeca-8035-41ba-aabd-4f8ba74bd065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:52.870273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92aeca-8035-41ba-aabd-4f8ba74bd065 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:52.870657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92aeca-8035-41ba-aabd-4f8ba74bd065 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:52.871065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92aeca-8035-41ba-aabd-4f8ba74bd065 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:52.878755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92aeca-8035-41ba-aabd-4f8ba74bd065 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:52.881391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92aeca-8035-41ba-aabd-4f8ba74bd065 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fa92aeca-8035-41ba-aabd-4f8ba74bd065 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:52.893183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:52.894284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:52.895954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:52.895954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:52.895954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:52.895954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:52.895954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:52.895954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:52.895954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:52.895954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:52.901051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167bd25-df0c-41d3-b048-58a197c64826 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:52.901987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 373/759] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:52.902898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92aeca-8035-41ba-aabd-4f8ba74bd065 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:52.941221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ecf7d-8172-4772-9deb-ff6cbd267e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:52.943010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ecf7d-8172-4772-9deb-ff6cbd267e79 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:52.943498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ecf7d-8172-4772-9deb-ff6cbd267e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:52.943966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ecf7d-8172-4772-9deb-ff6cbd267e79 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:52.944819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ecf7d-8172-4772-9deb-ff6cbd267e79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:52.945322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ecf7d-8172-4772-9deb-ff6cbd267e79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:52.947064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ecf7d-8172-4772-9deb-ff6cbd267e79 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:52.960732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 387/760] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:52.961867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ecf7d-8172-4772-9deb-ff6cbd267e79 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:53.000232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:53.020485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92aeca-8035-41ba-aabd-4f8ba74bd065 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:53.056655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:53.059901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fa8c7-3824-41c0-8f35-421375511550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:53.060617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa8c7-3824-41c0-8f35-421375511550 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:53.061000 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa8c7-3824-41c0-8f35-421375511550 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:53.061373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa8c7-3824-41c0-8f35-421375511550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:53.062247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fa8c7-3824-41c0-8f35-421375511550 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=ce739a6448604eae823fd285a0164b47) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:53.062614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fa8c7-3824-41c0-8f35-421375511550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:53.064176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fa8c7-3824-41c0-8f35-421375511550 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:53.078703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 374/761] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:52 2022] GET /identity/v3/role_assignments?user.id=ce739a6448604eae823fd285a0164b47&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:53.078703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fa8c7-3824-41c0-8f35-421375511550 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:53.079347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ecf7d-8172-4772-9deb-ff6cbd267e79 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:53.162024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2e79f-23e8-4f97-8446-a623386f6307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:53.162850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2e79f-23e8-4f97-8446-a623386f6307 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:53.163232 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2e79f-23e8-4f97-8446-a623386f6307 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:53.163606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2e79f-23e8-4f97-8446-a623386f6307 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:53.164444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2e79f-23e8-4f97-8446-a623386f6307 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:53.164852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2e79f-23e8-4f97-8446-a623386f6307 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:53.166862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2e79f-23e8-4f97-8446-a623386f6307 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:53.203869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 388/762] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:53.219831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2e79f-23e8-4f97-8446-a623386f6307 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:53.272226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fa8c7-3824-41c0-8f35-421375511550 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:53.343527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ac73c-aaae-45df-89e4-ca89f6452518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:53.344620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ac73c-aaae-45df-89e4-ca89f6452518 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:53.345536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ac73c-aaae-45df-89e4-ca89f6452518 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:53.345964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ac73c-aaae-45df-89e4-ca89f6452518 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:53.363103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ac73c-aaae-45df-89e4-ca89f6452518 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:53.365724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ac73c-aaae-45df-89e4-ca89f6452518 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:53.379871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2e79f-23e8-4f97-8446-a623386f6307 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ef6ac73c-aaae-45df-89e4-ca89f6452518 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:53.392889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:53.393985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:53.395867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:53.395867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:53.395867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:53.395867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:53.395867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:53.395867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:53.395867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:53.395867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:53.399313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 375/763] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:53.406877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ac73c-aaae-45df-89e4-ca89f6452518 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:53.423120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:53.458480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3e75e-ed58-4f25-945b-f51fc445801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:53.461544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3e75e-ed58-4f25-945b-f51fc445801e None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:53.462178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3e75e-ed58-4f25-945b-f51fc445801e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:53.463588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3e75e-ed58-4f25-945b-f51fc445801e None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/2c6603b106fa4db58f3d1b5099606ffa/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:53.466568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3e75e-ed58-4f25-945b-f51fc445801e None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=2c6603b106fa4db58f3d1b5099606ffa, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:53.468880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3e75e-ed58-4f25-945b-f51fc445801e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:53.492437 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 389/764] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:21:53 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/2c6603b106fa4db58f3d1b5099606ffa/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:21:53.604809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ac73c-aaae-45df-89e4-ca89f6452518 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:53.642058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973ae03-b06d-48b0-bd75-abb58a404547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:53.642693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973ae03-b06d-48b0-bd75-abb58a404547 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:53.642979 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973ae03-b06d-48b0-bd75-abb58a404547 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:53.643253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973ae03-b06d-48b0-bd75-abb58a404547 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:53.643945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973ae03-b06d-48b0-bd75-abb58a404547 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:53.644252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973ae03-b06d-48b0-bd75-abb58a404547 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:53.645874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973ae03-b06d-48b0-bd75-abb58a404547 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:53.659324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 376/765] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:53.665554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3e75e-ed58-4f25-945b-f51fc445801e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:53.686605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:53.802737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3e75e-ed58-4f25-945b-f51fc445801e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:53.841360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3d155-e6cd-4f16-baf1-0a3ce8715b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:53.841967 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3d155-e6cd-4f16-baf1-0a3ce8715b54 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:53.842241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3d155-e6cd-4f16-baf1-0a3ce8715b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:53.842506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3d155-e6cd-4f16-baf1-0a3ce8715b54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:53.843264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3d155-e6cd-4f16-baf1-0a3ce8715b54 None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=3a90574a4a3141b1a90f1080c6072b31) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:53.843571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3d155-e6cd-4f16-baf1-0a3ce8715b54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:53.844980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3d155-e6cd-4f16-baf1-0a3ce8715b54 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:53.851112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 390/766] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:21:53 2022] GET /identity/v3/role_assignments?user.id=3a90574a4a3141b1a90f1080c6072b31&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:54.031783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfacd1-f492-433b-8d96-5491cbc930ef None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:54.032285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfacd1-f492-433b-8d96-5491cbc930ef None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:54.032669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfacd1-f492-433b-8d96-5491cbc930ef None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:54.034562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 377/767] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:54.040594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed6597-cab9-4d49-b395-24c2e7a12e3f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:54.040952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed6597-cab9-4d49-b395-24c2e7a12e3f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:54.041298 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed6597-cab9-4d49-b395-24c2e7a12e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:54.068450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-92ed6597-cab9-4d49-b395-24c2e7a12e3f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:54.069696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-92ed6597-cab9-4d49-b395-24c2e7a12e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:54.165325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 391/768] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:21:54.306727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849037c-8cfc-4a59-87cf-467eb29134d9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:54.307213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849037c-8cfc-4a59-87cf-467eb29134d9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:54.307213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849037c-8cfc-4a59-87cf-467eb29134d9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:54.308726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 378/769] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:54.314110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1afb4-26a6-4a45-bc66-c1eb5163c94a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:54.314405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1afb4-26a6-4a45-bc66-c1eb5163c94a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:54.314705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1afb4-26a6-4a45-bc66-c1eb5163c94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:54.322250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:54.335989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-55a1afb4-26a6-4a45-bc66-c1eb5163c94a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:54.337180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-55a1afb4-26a6-4a45-bc66-c1eb5163c94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:54.409271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 392/770] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:21:54.597727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849037c-8cfc-4a59-87cf-467eb29134d9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:54.672451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:54.721006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849037c-8cfc-4a59-87cf-467eb29134d9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:54.765193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c1266-ef16-4654-9f61-c71822ba2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:54.765886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1266-ef16-4654-9f61-c71822ba2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:54.766218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1266-ef16-4654-9f61-c71822ba2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:54.766497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1266-ef16-4654-9f61-c71822ba2ae4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:54.767109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c1266-ef16-4654-9f61-c71822ba2ae4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:54.768478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c1266-ef16-4654-9f61-c71822ba2ae4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e61c1266-ef16-4654-9f61-c71822ba2ae4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:54.778233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:54.779273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:54.780127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 379/771] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:54 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:54.787408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1afb4-26a6-4a45-bc66-c1eb5163c94a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:54.850840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c1266-ef16-4654-9f61-c71822ba2ae4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:54.986072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1afb4-26a6-4a45-bc66-c1eb5163c94a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:55.028421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c1266-ef16-4654-9f61-c71822ba2ae4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:55.039800 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:55.049110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3845a72-05ca-4558-963d-bac13d172914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:55.049734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3845a72-05ca-4558-963d-bac13d172914 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:55.050012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3845a72-05ca-4558-963d-bac13d172914 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:55.050282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3845a72-05ca-4558-963d-bac13d172914 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:55.051788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3845a72-05ca-4558-963d-bac13d172914 None admin] RBAC: Adding query filter params (name=network) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:55.051910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3845a72-05ca-4558-963d-bac13d172914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:55.053596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3845a72-05ca-4558-963d-bac13d172914 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:55.059104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 393/772] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:21:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:55.064261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3845a72-05ca-4558-963d-bac13d172914 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:55.103511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:55.124781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604879e3-be90-4bbe-91e6-c204d20b804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:55.125414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604879e3-be90-4bbe-91e6-c204d20b804f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:55.125694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604879e3-be90-4bbe-91e6-c204d20b804f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:55.125965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604879e3-be90-4bbe-91e6-c204d20b804f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:55.126551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604879e3-be90-4bbe-91e6-c204d20b804f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:55.127963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604879e3-be90-4bbe-91e6-c204d20b804f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-604879e3-be90-4bbe-91e6-c204d20b804f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:55.143677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:55.144855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:55.145789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 380/773] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Oct 4 08:21:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:55.151454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604879e3-be90-4bbe-91e6-c204d20b804f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:55.182573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3845a72-05ca-4558-963d-bac13d172914 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:55.241031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84644804-a4ec-4fbb-9732-0fa8cc2e1d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:55.241911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84644804-a4ec-4fbb-9732-0fa8cc2e1d6a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:55.242338 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84644804-a4ec-4fbb-9732-0fa8cc2e1d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:55.244303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84644804-a4ec-4fbb-9732-0fa8cc2e1d6a None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:55.245091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84644804-a4ec-4fbb-9732-0fa8cc2e1d6a None admin] RBAC: Adding query filter params (type=network) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:55.245545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84644804-a4ec-4fbb-9732-0fa8cc2e1d6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:55.249920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84644804-a4ec-4fbb-9732-0fa8cc2e1d6a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:55.263653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 394/774] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:21:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:55.269145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84644804-a4ec-4fbb-9732-0fa8cc2e1d6a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:55.358462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604879e3-be90-4bbe-91e6-c204d20b804f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:55.391982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:55.406128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22b6a8-24bd-42b0-96fb-b7555f617bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:55.407119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22b6a8-24bd-42b0-96fb-b7555f617bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:55.407656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22b6a8-24bd-42b0-96fb-b7555f617bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:55.408677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22b6a8-24bd-42b0-96fb-b7555f617bc2 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:55.409665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22b6a8-24bd-42b0-96fb-b7555f617bc2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:55.410173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22b6a8-24bd-42b0-96fb-b7555f617bc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:55.411917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22b6a8-24bd-42b0-96fb-b7555f617bc2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:55.417563 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 381/775] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Oct 4 08:21:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:55.423183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22b6a8-24bd-42b0-96fb-b7555f617bc2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:55.497956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:55.509163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84644804-a4ec-4fbb-9732-0fa8cc2e1d6a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:55.572474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22b6a8-24bd-42b0-96fb-b7555f617bc2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:55.582384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48dd1c-5380-4cd7-8a69-0e4a14c1db1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:55.584495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48dd1c-5380-4cd7-8a69-0e4a14c1db1d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:55.584986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48dd1c-5380-4cd7-8a69-0e4a14c1db1d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:55.587010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48dd1c-5380-4cd7-8a69-0e4a14c1db1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:55.587927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48dd1c-5380-4cd7-8a69-0e4a14c1db1d None admin] RBAC: Adding query filter params (interface=public, service_id=d2d731219fc74764938c791df6f4247e, region_id=RegionOne) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:55.588441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48dd1c-5380-4cd7-8a69-0e4a14c1db1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:55.590498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48dd1c-5380-4cd7-8a69-0e4a14c1db1d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:55.608255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 395/776] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Oct 4 08:21:55 2022] GET /identity/v3/endpoints?service_id=d2d731219fc74764938c791df6f4247e&interface=public®ion_id=RegionOne => generated 194 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:55.614148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48dd1c-5380-4cd7-8a69-0e4a14c1db1d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:55.648211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139115e-14ea-49a0-ba92-85e480d4ac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:55.648838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139115e-14ea-49a0-ba92-85e480d4ac61 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:55.649114 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139115e-14ea-49a0-ba92-85e480d4ac61 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:55.649382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139115e-14ea-49a0-ba92-85e480d4ac61 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:55.650024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139115e-14ea-49a0-ba92-85e480d4ac61 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:55.650326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139115e-14ea-49a0-ba92-85e480d4ac61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:55.651764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139115e-14ea-49a0-ba92-85e480d4ac61 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:55.662068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 382/777] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Oct 4 08:21:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:55.668427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139115e-14ea-49a0-ba92-85e480d4ac61 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:55.743617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48dd1c-5380-4cd7-8a69-0e4a14c1db1d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:55.767980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:55.783222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9933fc-406d-4c23-afd8-02f7d71fcd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:55.783833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9933fc-406d-4c23-afd8-02f7d71fcd44 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:55.784106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9933fc-406d-4c23-afd8-02f7d71fcd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:55.784370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9933fc-406d-4c23-afd8-02f7d71fcd44 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:55.784975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9933fc-406d-4c23-afd8-02f7d71fcd44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:55.787608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9933fc-406d-4c23-afd8-02f7d71fcd44 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:55.798821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 396/778] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Oct 4 08:21:55 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:55.800289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddfdfb-64b0-47da-9376-5f371a9c6790 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:55.800830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddfdfb-64b0-47da-9376-5f371a9c6790 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:55.802091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddfdfb-64b0-47da-9376-5f371a9c6790 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:55.808068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 397/779] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:55.809892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8ea0d-5000-4e6b-a9a8-ee94f7824ffb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:55.810171 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8ea0d-5000-4e6b-a9a8-ee94f7824ffb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:55.810447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8ea0d-5000-4e6b-a9a8-ee94f7824ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:55.859812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f1b8ea0d-5000-4e6b-a9a8-ee94f7824ffb None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:55.861031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f1b8ea0d-5000-4e6b-a9a8-ee94f7824ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:55.864830 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139115e-14ea-49a0-ba92-85e480d4ac61 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:55.890758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:55.904522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee45b-ed46-4d39-82e0-5e58dcc01f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:55.905562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee45b-ed46-4d39-82e0-5e58dcc01f3f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:55.906046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee45b-ed46-4d39-82e0-5e58dcc01f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:55.906518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee45b-ed46-4d39-82e0-5e58dcc01f3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:55.907452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee45b-ed46-4d39-82e0-5e58dcc01f3f None admin] RBAC: Adding query filter params (interface=public, service_id=6b86ed5bf5714603884ecd72ed9e3e08, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:55.908014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee45b-ed46-4d39-82e0-5e58dcc01f3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:55.909606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee45b-ed46-4d39-82e0-5e58dcc01f3f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:55.918953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 383/780] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Oct 4 08:21:55 2022] GET /identity/v3/endpoints?service_id=6b86ed5bf5714603884ecd72ed9e3e08&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:21:55.924846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee45b-ed46-4d39-82e0-5e58dcc01f3f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:56.001934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 398/781] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:21:56.068279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee45b-ed46-4d39-82e0-5e58dcc01f3f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:56.112784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400888b6-a8c1-4664-8e04-1fbcc1c44f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:56.113943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400888b6-a8c1-4664-8e04-1fbcc1c44f65 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:56.114711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400888b6-a8c1-4664-8e04-1fbcc1c44f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:56.114711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400888b6-a8c1-4664-8e04-1fbcc1c44f65 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:56.115179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400888b6-a8c1-4664-8e04-1fbcc1c44f65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:56.116512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400888b6-a8c1-4664-8e04-1fbcc1c44f65 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:56.123659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 384/782] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Oct 4 08:21:55 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:56.326009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d1764-a93b-47a7-8600-330e380a0081 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:56.326391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d1764-a93b-47a7-8600-330e380a0081 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:56.326571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d1764-a93b-47a7-8600-330e380a0081 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:56.328221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 399/783] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:56.335043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef44a7-15b2-46b6-9f9b-cd7ab745ac4f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:56.335362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef44a7-15b2-46b6-9f9b-cd7ab745ac4f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:56.335608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef44a7-15b2-46b6-9f9b-cd7ab745ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:56.335772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d1764-a93b-47a7-8600-330e380a0081 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:56.366016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bbef44a7-15b2-46b6-9f9b-cd7ab745ac4f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:56.367199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bbef44a7-15b2-46b6-9f9b-cd7ab745ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:56.445680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:56.471641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d1764-a93b-47a7-8600-330e380a0081 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:56.487249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 385/784] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:21:56.498253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:56.518844 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905d48f-8e22-4870-99ae-dc4854842178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:56.519484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d48f-8e22-4870-99ae-dc4854842178 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:56.519786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d48f-8e22-4870-99ae-dc4854842178 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:56.520417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d48f-8e22-4870-99ae-dc4854842178 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:56.536621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905d48f-8e22-4870-99ae-dc4854842178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-a905d48f-8e22-4870-99ae-dc4854842178 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:56.541238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:56.542177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:56.543090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:56.543733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab928c1-035d-482b-a9ff-cc12a7f1b4d3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:56.543733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab928c1-035d-482b-a9ff-cc12a7f1b4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:56.543870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 400/785] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:56.543955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab928c1-035d-482b-a9ff-cc12a7f1b4d3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:56.545283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 386/786] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:21:56.549968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905d48f-8e22-4870-99ae-dc4854842178 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:56.555085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d906a-bd86-42cb-b577-1325c7aa3712 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:56.555369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d906a-bd86-42cb-b577-1325c7aa3712 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:56.555640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d906a-bd86-42cb-b577-1325c7aa3712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:56.595733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f91d906a-bd86-42cb-b577-1325c7aa3712 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:56.597292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f91d906a-bd86-42cb-b577-1325c7aa3712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:56.662226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905d48f-8e22-4870-99ae-dc4854842178 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:56.697864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566abd7-81f6-4142-9849-2acf449d6678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:56.698472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566abd7-81f6-4142-9849-2acf449d6678 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:56.698799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566abd7-81f6-4142-9849-2acf449d6678 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:56.699075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566abd7-81f6-4142-9849-2acf449d6678 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:56.699758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566abd7-81f6-4142-9849-2acf449d6678 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:56.700048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566abd7-81f6-4142-9849-2acf449d6678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:56.701429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566abd7-81f6-4142-9849-2acf449d6678 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:56.710583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 401/787] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:56.712569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 387/788] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:21:56.718660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566abd7-81f6-4142-9849-2acf449d6678 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:56.773127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d906a-bd86-42cb-b577-1325c7aa3712 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:56.783040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:56.898015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d906a-bd86-42cb-b577-1325c7aa3712 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:56.911114 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:56.928738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566abd7-81f6-4142-9849-2acf449d6678 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:56.947932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40c0b7-1bee-49f2-bc37-06a5e6d8351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:56.948581 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40c0b7-1bee-49f2-bc37-06a5e6d8351e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:56.948864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40c0b7-1bee-49f2-bc37-06a5e6d8351e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:56.949139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40c0b7-1bee-49f2-bc37-06a5e6d8351e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:56.969777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40c0b7-1bee-49f2-bc37-06a5e6d8351e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1e40c0b7-1bee-49f2-bc37-06a5e6d8351e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:56.975148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:56.976071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:56.977421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 388/789] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:56.985602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40c0b7-1bee-49f2-bc37-06a5e6d8351e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:57.004866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db0037-80d3-4383-9e42-966e4dc17a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:57.005541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db0037-80d3-4383-9e42-966e4dc17a8a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:57.005822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db0037-80d3-4383-9e42-966e4dc17a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:57.006102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db0037-80d3-4383-9e42-966e4dc17a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:57.030758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db0037-80d3-4383-9e42-966e4dc17a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:57.032236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db0037-80d3-4383-9e42-966e4dc17a8a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-34db0037-80d3-4383-9e42-966e4dc17a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:57.066448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:57.068738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:57.070898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:57.070898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:57.070898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:57.070898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 402/790] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:57.073670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db0037-80d3-4383-9e42-966e4dc17a8a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:57.163065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40c0b7-1bee-49f2-bc37-06a5e6d8351e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:57.171208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:57.183145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db0037-80d3-4383-9e42-966e4dc17a8a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:57.204835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdcef5-9745-481c-bba0-3b955b2fef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:57.205757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdcef5-9745-481c-bba0-3b955b2fef69 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:57.206287 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdcef5-9745-481c-bba0-3b955b2fef69 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:57.206792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdcef5-9745-481c-bba0-3b955b2fef69 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:57.208488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdcef5-9745-481c-bba0-3b955b2fef69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:57.208998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdcef5-9745-481c-bba0-3b955b2fef69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:57.210562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdcef5-9745-481c-bba0-3b955b2fef69 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:57.219350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 389/791] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:21:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:57.220508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdcef5-9745-481c-bba0-3b955b2fef69 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:57.227331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6de5b-a0b8-41d0-8a9e-ed1d9709eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:57.227971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6de5b-a0b8-41d0-8a9e-ed1d9709eb9b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:57.228248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6de5b-a0b8-41d0-8a9e-ed1d9709eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:57.228520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6de5b-a0b8-41d0-8a9e-ed1d9709eb9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:57.240395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6de5b-a0b8-41d0-8a9e-ed1d9709eb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-47c6de5b-a0b8-41d0-8a9e-ed1d9709eb9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:21:57.245939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:57.246913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:57.247769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 403/792] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:21:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:21:57.248468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6de5b-a0b8-41d0-8a9e-ed1d9709eb9b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:57.264074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:57.359137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6de5b-a0b8-41d0-8a9e-ed1d9709eb9b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:57.361141 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdcef5-9745-481c-bba0-3b955b2fef69 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:57.395510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b60066-9012-44fa-bbef-a9838f53394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:57.396308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60066-9012-44fa-bbef-a9838f53394d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:57.396666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60066-9012-44fa-bbef-a9838f53394d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:57.397000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60066-9012-44fa-bbef-a9838f53394d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:57.405458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5618a-e5cd-4838-ac3c-24701f137e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:57.407136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5618a-e5cd-4838-ac3c-24701f137e8f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:57.407603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5618a-e5cd-4838-ac3c-24701f137e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:57.408305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5618a-e5cd-4838-ac3c-24701f137e8f None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:57.408809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b60066-9012-44fa-bbef-a9838f53394d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:57.409328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5618a-e5cd-4838-ac3c-24701f137e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:57.409807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5618a-e5cd-4838-ac3c-24701f137e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:57.411133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b60066-9012-44fa-bbef-a9838f53394d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:57.412330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5618a-e5cd-4838-ac3c-24701f137e8f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-06b60066-9012-44fa-bbef-a9838f53394d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:57.426694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:57.427661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:57.428581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:57.428581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:57.428581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:57.429447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 390/793] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:57.430546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5618a-e5cd-4838-ac3c-24701f137e8f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:57.432793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 404/794] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:57.434012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b60066-9012-44fa-bbef-a9838f53394d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:57.438649 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:57.544060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:57.556013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5618a-e5cd-4838-ac3c-24701f137e8f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:57.567622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b60066-9012-44fa-bbef-a9838f53394d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:57.601480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdeead0-3fc4-4034-bb32-8dca2953c58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:57.602523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeead0-3fc4-4034-bb32-8dca2953c58a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:57.603073 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeead0-3fc4-4034-bb32-8dca2953c58a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:57.603605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeead0-3fc4-4034-bb32-8dca2953c58a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:57.604093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3369986-fbe1-49d0-8c97-b525a9fcc715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:57.604674 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdeead0-3fc4-4034-bb32-8dca2953c58a None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:57.604779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369986-fbe1-49d0-8c97-b525a9fcc715 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:57.605125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369986-fbe1-49d0-8c97-b525a9fcc715 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:57.605428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdeead0-3fc4-4034-bb32-8dca2953c58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:57.605547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369986-fbe1-49d0-8c97-b525a9fcc715 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:57.606231 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3369986-fbe1-49d0-8c97-b525a9fcc715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:57.606595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3369986-fbe1-49d0-8c97-b525a9fcc715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:57.607474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdeead0-3fc4-4034-bb32-8dca2953c58a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:57.608129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3369986-fbe1-49d0-8c97-b525a9fcc715 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:57.623392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 391/795] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:21:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:57.623883 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdeead0-3fc4-4034-bb32-8dca2953c58a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:57.626020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 405/796] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:57.626879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3369986-fbe1-49d0-8c97-b525a9fcc715 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:57.698247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:57.748543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdeead0-3fc4-4034-bb32-8dca2953c58a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:57.752108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3369986-fbe1-49d0-8c97-b525a9fcc715 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:57.783321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c34e39-e233-4a42-8b17-db7175e1e387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:57.783955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34e39-e233-4a42-8b17-db7175e1e387 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:57.784237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34e39-e233-4a42-8b17-db7175e1e387 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:57.784511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34e39-e233-4a42-8b17-db7175e1e387 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:57.794076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c34e39-e233-4a42-8b17-db7175e1e387 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:57.795514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c34e39-e233-4a42-8b17-db7175e1e387 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:57.802428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf15fa2-a0d7-4e91-872a-6fa14823bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:57.803659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf15fa2-a0d7-4e91-872a-6fa14823bd28 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:57.804137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf15fa2-a0d7-4e91-872a-6fa14823bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:57.804632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf15fa2-a0d7-4e91-872a-6fa14823bd28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-35c34e39-e233-4a42-8b17-db7175e1e387 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:57.808281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:57.809208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:57.810154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 392/797] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:21:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:57.810778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c34e39-e233-4a42-8b17-db7175e1e387 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:57.821134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf15fa2-a0d7-4e91-872a-6fa14823bd28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:57.823072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf15fa2-a0d7-4e91-872a-6fa14823bd28 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:57.830260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-8bf15fa2-a0d7-4e91-872a-6fa14823bd28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:57.851202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:57.852247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:57.853187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:57.853187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:57.853187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:57.860591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 406/798] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:57.860591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf15fa2-a0d7-4e91-872a-6fa14823bd28 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:57.931985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c34e39-e233-4a42-8b17-db7175e1e387 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:57.971302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17295fac-f6ae-46f5-b735-edaaf38e55a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:57.972352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295fac-f6ae-46f5-b735-edaaf38e55a8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:57.974575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295fac-f6ae-46f5-b735-edaaf38e55a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:57.975104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295fac-f6ae-46f5-b735-edaaf38e55a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:57.986294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17295fac-f6ae-46f5-b735-edaaf38e55a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:57.989544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17295fac-f6ae-46f5-b735-edaaf38e55a8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.000133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf15fa2-a0d7-4e91-872a-6fa14823bd28 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-17295fac-f6ae-46f5-b735-edaaf38e55a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:58.007767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:58.008829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:58.009791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:58.009791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:58.009791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:58.009791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:58.009791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:58.009791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:58.009791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:58.009791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:58.009791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:21:58.009791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:58.012582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 393/799] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Oct 4 08:21:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:58.013529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17295fac-f6ae-46f5-b735-edaaf38e55a8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:58.027567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:58.048064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642a48-3dcc-4edc-a73a-d0080409cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:58.048810 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642a48-3dcc-4edc-a73a-d0080409cc40 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.049183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642a48-3dcc-4edc-a73a-d0080409cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.049551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642a48-3dcc-4edc-a73a-d0080409cc40 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.050380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642a48-3dcc-4edc-a73a-d0080409cc40 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:58.051143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642a48-3dcc-4edc-a73a-d0080409cc40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:58.052718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642a48-3dcc-4edc-a73a-d0080409cc40 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.071990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 407/800] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Oct 4 08:21:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:58.073058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642a48-3dcc-4edc-a73a-d0080409cc40 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:58.112508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:58.147308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17295fac-f6ae-46f5-b735-edaaf38e55a8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:58.189438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642a48-3dcc-4edc-a73a-d0080409cc40 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:58.195174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b2262-c024-4a88-bcb1-1fdb97ecde94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:58.195993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b2262-c024-4a88-bcb1-1fdb97ecde94 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.196433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b2262-c024-4a88-bcb1-1fdb97ecde94 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.196846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b2262-c024-4a88-bcb1-1fdb97ecde94 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.197627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b2262-c024-4a88-bcb1-1fdb97ecde94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:58.198074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b2262-c024-4a88-bcb1-1fdb97ecde94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:58.200188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b2262-c024-4a88-bcb1-1fdb97ecde94 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.222523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 394/801] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:58.222523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b2262-c024-4a88-bcb1-1fdb97ecde94 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:58.237493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb6c3c-5ecb-455c-87af-67a9146282be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:58.240273 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb6c3c-5ecb-455c-87af-67a9146282be None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.240737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb6c3c-5ecb-455c-87af-67a9146282be None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.241174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb6c3c-5ecb-455c-87af-67a9146282be None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.242076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb6c3c-5ecb-455c-87af-67a9146282be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:58.242522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb6c3c-5ecb-455c-87af-67a9146282be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:58.244621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb6c3c-5ecb-455c-87af-67a9146282be None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.265397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 408/802] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Oct 4 08:21:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:58.266443 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb6c3c-5ecb-455c-87af-67a9146282be None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:58.302898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:58.341998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b2262-c024-4a88-bcb1-1fdb97ecde94 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:58.383468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb6c3c-5ecb-455c-87af-67a9146282be None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:58.383893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b698ed-4044-4056-bf3c-0fc4a591a8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:58.384630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b698ed-4044-4056-bf3c-0fc4a591a8bc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.385007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b698ed-4044-4056-bf3c-0fc4a591a8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.385376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b698ed-4044-4056-bf3c-0fc4a591a8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.387597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:58.398717 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b698ed-4044-4056-bf3c-0fc4a591a8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:58.400841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b698ed-4044-4056-bf3c-0fc4a591a8bc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-77b698ed-4044-4056-bf3c-0fc4a591a8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:58.417043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:58.418625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:58.419607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:58.419607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:58.419607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:58.420050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 395/803] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:58.421142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b698ed-4044-4056-bf3c-0fc4a591a8bc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:58.427099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb58cd-0931-42b2-9809-4246bbef0a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:58.428002 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb58cd-0931-42b2-9809-4246bbef0a89 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.428455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb58cd-0931-42b2-9809-4246bbef0a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.428914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb58cd-0931-42b2-9809-4246bbef0a89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.436600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb58cd-0931-42b2-9809-4246bbef0a89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:58.438299 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb58cd-0931-42b2-9809-4246bbef0a89 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-1fdb58cd-0931-42b2-9809-4246bbef0a89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:21:58.451754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:58.452710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:58.453670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:58.453670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:58.453670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:21:58.453670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:21:58.453670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:21:58.453670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:21:58.453670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:21:58.453670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:21:58.453670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:21:58.453670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:58.461096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 409/804] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Oct 4 08:21:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:58.462565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb58cd-0931-42b2-9809-4246bbef0a89 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:58.548413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b698ed-4044-4056-bf3c-0fc4a591a8bc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:58.580532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:58.582999 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294209-86df-439f-9202-c3a15decc2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:58.583618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294209-86df-439f-9202-c3a15decc2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.583931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294209-86df-439f-9202-c3a15decc2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.584203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294209-86df-439f-9202-c3a15decc2b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.591960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb58cd-0931-42b2-9809-4246bbef0a89 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:58.629651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbab9c-e181-448c-8a20-f25ed373c42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:58.630234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbab9c-e181-448c-8a20-f25ed373c42b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.630509 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbab9c-e181-448c-8a20-f25ed373c42b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.630816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbab9c-e181-448c-8a20-f25ed373c42b None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.631452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbab9c-e181-448c-8a20-f25ed373c42b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:58.631755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbab9c-e181-448c-8a20-f25ed373c42b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:58.633153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbab9c-e181-448c-8a20-f25ed373c42b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.640389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:58.644994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 410/805] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:58.645808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbab9c-e181-448c-8a20-f25ed373c42b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:58.658642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26294209-86df-439f-9202-c3a15decc2b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:58.660667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26294209-86df-439f-9202-c3a15decc2b5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.741707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbab9c-e181-448c-8a20-f25ed373c42b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:58.758037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 396/806] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:21:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:21:58.759318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bea918-9863-4519-894c-0bfbf6498bfa None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.759612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bea918-9863-4519-894c-0bfbf6498bfa None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.759888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bea918-9863-4519-894c-0bfbf6498bfa None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.761116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 397/807] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:58.762135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cf5ec-fe7f-48db-a0ff-8fce6c4a6b5f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.762414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cf5ec-fe7f-48db-a0ff-8fce6c4a6b5f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.762705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cf5ec-fe7f-48db-a0ff-8fce6c4a6b5f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.763877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 398/808] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:21:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:21:58.764571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cf5ec-fe7f-48db-a0ff-8fce6c4a6b5f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:58.780246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9776e7-dacb-4dcc-8ced-0f61d4983b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:58.780902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9776e7-dacb-4dcc-8ced-0f61d4983b66 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.781175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9776e7-dacb-4dcc-8ced-0f61d4983b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.781467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9776e7-dacb-4dcc-8ced-0f61d4983b66 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.782190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9776e7-dacb-4dcc-8ced-0f61d4983b66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:58.782488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9776e7-dacb-4dcc-8ced-0f61d4983b66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:58.783934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9776e7-dacb-4dcc-8ced-0f61d4983b66 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.802735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 411/809] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Oct 4 08:21:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:58.803463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9776e7-dacb-4dcc-8ced-0f61d4983b66 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:58.815131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:58.856096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:58.872598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cf5ec-fe7f-48db-a0ff-8fce6c4a6b5f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:58.903388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9776e7-dacb-4dcc-8ced-0f61d4983b66 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:58.905506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196707b7-3f14-4d7d-b04c-1f129ec57066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:58.906128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196707b7-3f14-4d7d-b04c-1f129ec57066 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.906411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196707b7-3f14-4d7d-b04c-1f129ec57066 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.906705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196707b7-3f14-4d7d-b04c-1f129ec57066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.913962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196707b7-3f14-4d7d-b04c-1f129ec57066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:58.915435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196707b7-3f14-4d7d-b04c-1f129ec57066 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-196707b7-3f14-4d7d-b04c-1f129ec57066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:58.927286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:58.928230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:58.929124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:58.929124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:58.929124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:58.929124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:58.929124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:58.929124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:58.929124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:58.929124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:58.929124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 399/810] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:58.929609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636d094-9d4c-4433-b6f1-caed92788bc8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.929830 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636d094-9d4c-4433-b6f1-caed92788bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.930047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636d094-9d4c-4433-b6f1-caed92788bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.941907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc2c09-1497-4961-a3e4-49f126633722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:58.942757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc2c09-1497-4961-a3e4-49f126633722 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.943036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc2c09-1497-4961-a3e4-49f126633722 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.943309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc2c09-1497-4961-a3e4-49f126633722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.947133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8636d094-9d4c-4433-b6f1-caed92788bc8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:58.948324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8636d094-9d4c-4433-b6f1-caed92788bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:58.953396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc2c09-1497-4961-a3e4-49f126633722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:58.954859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc2c09-1497-4961-a3e4-49f126633722 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-dfdc2c09-1497-4961-a3e4-49f126633722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:58.969140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:58.970129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:58.971064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:58.971064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:58.971064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:58.971064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 412/811] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:58.971746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e642e-4e48-4a07-b3b1-96e780240292 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:58.971746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e642e-4e48-4a07-b3b1-96e780240292 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:58.972000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e642e-4e48-4a07-b3b1-96e780240292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:58.990154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dd1e642e-4e48-4a07-b3b1-96e780240292 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:21:58.991381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dd1e642e-4e48-4a07-b3b1-96e780240292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:21:59.015101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 400/812] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:21:59.015869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636d094-9d4c-4433-b6f1-caed92788bc8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.058108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:59.071127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 413/813] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:21:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:21:59.071953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e642e-4e48-4a07-b3b1-96e780240292 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.109066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:59.135807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636d094-9d4c-4433-b6f1-caed92788bc8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:59.171410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1fe7c-8867-40c0-8ea3-66726696330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:59.172033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1fe7c-8867-40c0-8ea3-66726696330b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:59.172308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1fe7c-8867-40c0-8ea3-66726696330b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:59.172575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1fe7c-8867-40c0-8ea3-66726696330b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:59.183139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1fe7c-8867-40c0-8ea3-66726696330b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:59.184597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1fe7c-8867-40c0-8ea3-66726696330b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-bdd1fe7c-8867-40c0-8ea3-66726696330b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:21:59.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:59.201289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:21:59.202189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:21:59.202189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:21:59.202189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:59.202189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 401/814] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:59.202873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1fe7c-8867-40c0-8ea3-66726696330b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.203815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e642e-4e48-4a07-b3b1-96e780240292 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:59.254518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109fe02-983c-4046-a993-ceb619d54daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:59.255559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109fe02-983c-4046-a993-ceb619d54daf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:59.256072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109fe02-983c-4046-a993-ceb619d54daf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:59.256549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109fe02-983c-4046-a993-ceb619d54daf None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:59.258024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109fe02-983c-4046-a993-ceb619d54daf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:59.258817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109fe02-983c-4046-a993-ceb619d54daf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:59.261158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109fe02-983c-4046-a993-ceb619d54daf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:59.278575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 414/815] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:59.279707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109fe02-983c-4046-a993-ceb619d54daf None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.308442 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1fe7c-8867-40c0-8ea3-66726696330b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:59.339827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:59.342951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:59.352286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a399a-0356-4937-b1cb-e22cc1337196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:59.353157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a399a-0356-4937-b1cb-e22cc1337196 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:59.353439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a399a-0356-4937-b1cb-e22cc1337196 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:59.353710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a399a-0356-4937-b1cb-e22cc1337196 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:59.354345 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a399a-0356-4937-b1cb-e22cc1337196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:59.354648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a399a-0356-4937-b1cb-e22cc1337196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:59.356928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a399a-0356-4937-b1cb-e22cc1337196 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:59.369230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 402/816] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:59.369864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a399a-0356-4937-b1cb-e22cc1337196 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.397664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109fe02-983c-4046-a993-ceb619d54daf None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:59.430632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9cab6-97b2-4b8e-85e9-afff7816a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:59.431252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9cab6-97b2-4b8e-85e9-afff7816a341 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:59.431530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9cab6-97b2-4b8e-85e9-afff7816a341 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:59.431801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9cab6-97b2-4b8e-85e9-afff7816a341 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:59.432429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9cab6-97b2-4b8e-85e9-afff7816a341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:59.432732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9cab6-97b2-4b8e-85e9-afff7816a341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:59.434090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9cab6-97b2-4b8e-85e9-afff7816a341 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:59.445753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 415/817] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:59.446346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9cab6-97b2-4b8e-85e9-afff7816a341 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.470931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a399a-0356-4937-b1cb-e22cc1337196 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:59.504452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77ff68-d57c-4ea5-a534-7478a2936a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:59.505137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77ff68-d57c-4ea5-a534-7478a2936a71 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:59.505440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77ff68-d57c-4ea5-a534-7478a2936a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:59.505709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77ff68-d57c-4ea5-a534-7478a2936a71 None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/ce739a6448604eae823fd285a0164b47/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:59.507667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77ff68-d57c-4ea5-a534-7478a2936a71 None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=ce739a6448604eae823fd285a0164b47, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:59.509090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77ff68-d57c-4ea5-a534-7478a2936a71 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:59.521863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 403/818] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:21:59 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/ce739a6448604eae823fd285a0164b47/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:21:59.522649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77ff68-d57c-4ea5-a534-7478a2936a71 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.552567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9cab6-97b2-4b8e-85e9-afff7816a341 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:59.567963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:59.591805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae853c-9e81-4fee-9a3b-709c5d79aebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:59.592566 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae853c-9e81-4fee-9a3b-709c5d79aebf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:59.592843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae853c-9e81-4fee-9a3b-709c5d79aebf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:59.593110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae853c-9e81-4fee-9a3b-709c5d79aebf None admin] PATH_INFO: `/v3/services/network` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:59.593780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae853c-9e81-4fee-9a3b-709c5d79aebf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:59.595150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae853c-9e81-4fee-9a3b-709c5d79aebf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:59.596090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-63ae853c-9e81-4fee-9a3b-709c5d79aebf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:59.606036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:59.607204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:59.608073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 416/819] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:59.609515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae853c-9e81-4fee-9a3b-709c5d79aebf None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.659833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77ff68-d57c-4ea5-a534-7478a2936a71 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:59.701723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d034c9-0589-4dbc-981f-17fa06bf7df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:59.702363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d034c9-0589-4dbc-981f-17fa06bf7df6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:59.702644 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d034c9-0589-4dbc-981f-17fa06bf7df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:59.702973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d034c9-0589-4dbc-981f-17fa06bf7df6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:59.712353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d034c9-0589-4dbc-981f-17fa06bf7df6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:59.713797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d034c9-0589-4dbc-981f-17fa06bf7df6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-89d034c9-0589-4dbc-981f-17fa06bf7df6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:59.725380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:59.726507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:59.727689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:59.727689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:59.727689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:59.727689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:59.727689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:59.727689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:59.727689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:59.727689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:59.727689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 404/820] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:59.727689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d034c9-0589-4dbc-981f-17fa06bf7df6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.734936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae853c-9e81-4fee-9a3b-709c5d79aebf None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:59.772170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a503632-f387-4264-b2ec-ac6eccd57ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:59.772812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a503632-f387-4264-b2ec-ac6eccd57ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:59.773546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a503632-f387-4264-b2ec-ac6eccd57ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:59.773824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a503632-f387-4264-b2ec-ac6eccd57ba9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:59.774855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a503632-f387-4264-b2ec-ac6eccd57ba9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:59.776462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a503632-f387-4264-b2ec-ac6eccd57ba9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0a503632-f387-4264-b2ec-ac6eccd57ba9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:59.788703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:59.789725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:21:59.790586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:21:59.791421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 417/821] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:59.792090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a503632-f387-4264-b2ec-ac6eccd57ba9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.835716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:59.846055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d034c9-0589-4dbc-981f-17fa06bf7df6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:59.856758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:21:59.885416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e36d2-4960-430e-a4a5-0ebf8d54a73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:59.886049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e36d2-4960-430e-a4a5-0ebf8d54a73d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:59.886322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e36d2-4960-430e-a4a5-0ebf8d54a73d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:59.886593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e36d2-4960-430e-a4a5-0ebf8d54a73d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:59.893986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e36d2-4960-430e-a4a5-0ebf8d54a73d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:59.895792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e36d2-4960-430e-a4a5-0ebf8d54a73d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:59.904535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a503632-f387-4264-b2ec-ac6eccd57ba9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-368e36d2-4960-430e-a4a5-0ebf8d54a73d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:21:59.907329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:21:59.908219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:21:59.909100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:21:59.909100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:21:59.909100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:21:59.909100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:21:59.909100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:21:59.909100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:21:59.909100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:21:59.909100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:21:59.909100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 405/822] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:21:59.909583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e36d2-4960-430e-a4a5-0ebf8d54a73d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:21:59.943513 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cdd7c-fd50-4a8a-a25d-3a9a35dbda4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:21:59.944112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cdd7c-fd50-4a8a-a25d-3a9a35dbda4e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:21:59.944391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cdd7c-fd50-4a8a-a25d-3a9a35dbda4e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:21:59.944932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cdd7c-fd50-4a8a-a25d-3a9a35dbda4e None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:21:59.945277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cdd7c-fd50-4a8a-a25d-3a9a35dbda4e None admin] RBAC: Adding query filter params (name=network) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:21:59.945582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cdd7c-fd50-4a8a-a25d-3a9a35dbda4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:21:59.946961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cdd7c-fd50-4a8a-a25d-3a9a35dbda4e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:21:59.955641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 418/823] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:21:59.955641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cdd7c-fd50-4a8a-a25d-3a9a35dbda4e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:00.029035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e36d2-4960-430e-a4a5-0ebf8d54a73d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:00.068899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9554e-4692-4bc6-80e9-5e693d85cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:00.069525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9554e-4692-4bc6-80e9-5e693d85cf26 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:00.069804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9554e-4692-4bc6-80e9-5e693d85cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:00.070074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9554e-4692-4bc6-80e9-5e693d85cf26 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:00.070811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9554e-4692-4bc6-80e9-5e693d85cf26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:00.071119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9554e-4692-4bc6-80e9-5e693d85cf26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:00.072609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9554e-4692-4bc6-80e9-5e693d85cf26 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:00.091802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 406/824] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:00.091802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9554e-4692-4bc6-80e9-5e693d85cf26 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:00.122176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:00.170000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cdd7c-fd50-4a8a-a25d-3a9a35dbda4e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:00.172449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:00.206999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb306e-748f-4d38-8141-33808aea7848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:00.208200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb306e-748f-4d38-8141-33808aea7848 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:00.208399 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb306e-748f-4d38-8141-33808aea7848 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:00.208666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb306e-748f-4d38-8141-33808aea7848 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:00.208796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9554e-4692-4bc6-80e9-5e693d85cf26 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:00.209293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb306e-748f-4d38-8141-33808aea7848 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:00.209590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb306e-748f-4d38-8141-33808aea7848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:00.211006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb306e-748f-4d38-8141-33808aea7848 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:00.220606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 419/825] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Oct 4 08:21:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:00.220606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb306e-748f-4d38-8141-33808aea7848 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:00.248782 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd58f5c-57a9-4c7e-9d34-883543c7dab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:00.249388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd58f5c-57a9-4c7e-9d34-883543c7dab8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:00.249662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd58f5c-57a9-4c7e-9d34-883543c7dab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:00.249973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd58f5c-57a9-4c7e-9d34-883543c7dab8 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:00.250661 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd58f5c-57a9-4c7e-9d34-883543c7dab8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:00.250998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd58f5c-57a9-4c7e-9d34-883543c7dab8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:00.252420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd58f5c-57a9-4c7e-9d34-883543c7dab8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:00.267878 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 407/826] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:22:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:00.269091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd58f5c-57a9-4c7e-9d34-883543c7dab8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:00.328274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb306e-748f-4d38-8141-33808aea7848 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:00.363635 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:00.365337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c960-0240-47e8-943b-778bb4a088ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:00.366019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c960-0240-47e8-943b-778bb4a088ee None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:00.366331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c960-0240-47e8-943b-778bb4a088ee None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:00.366754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c960-0240-47e8-943b-778bb4a088ee None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:00.367419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8c960-0240-47e8-943b-778bb4a088ee None admin] RBAC: Adding query filter params (type=network) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:00.367713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8c960-0240-47e8-943b-778bb4a088ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:00.369064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8c960-0240-47e8-943b-778bb4a088ee None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:00.373887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 420/827] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:22:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:00.374652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c960-0240-47e8-943b-778bb4a088ee None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:00.384022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd58f5c-57a9-4c7e-9d34-883543c7dab8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:00.407572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:00.427871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec416-f8ee-4e51-9110-791ffb949f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:00.428487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec416-f8ee-4e51-9110-791ffb949f13 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:00.428771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec416-f8ee-4e51-9110-791ffb949f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:00.429043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec416-f8ee-4e51-9110-791ffb949f13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:00.429773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aec416-f8ee-4e51-9110-791ffb949f13 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=2c6603b106fa4db58f3d1b5099606ffa) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:00.430084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aec416-f8ee-4e51-9110-791ffb949f13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:00.431562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aec416-f8ee-4e51-9110-791ffb949f13 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:00.437497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 408/828] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:00 2022] GET /identity/v3/role_assignments?user.id=2c6603b106fa4db58f3d1b5099606ffa&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:00.438246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec416-f8ee-4e51-9110-791ffb949f13 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:00.505966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c960-0240-47e8-943b-778bb4a088ee None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:00.544585 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65749272-d4ef-4dec-a053-134d29a512f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:00.545518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65749272-d4ef-4dec-a053-134d29a512f5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:00.546090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65749272-d4ef-4dec-a053-134d29a512f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:00.546539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65749272-d4ef-4dec-a053-134d29a512f5 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:00.547462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65749272-d4ef-4dec-a053-134d29a512f5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:00.548036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65749272-d4ef-4dec-a053-134d29a512f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:00.549600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65749272-d4ef-4dec-a053-134d29a512f5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:00.556041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 421/829] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Oct 4 08:22:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:00.557205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65749272-d4ef-4dec-a053-134d29a512f5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:00.607726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec416-f8ee-4e51-9110-791ffb949f13 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:00.660104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98d73d-6cd8-4327-aa1a-2e998ab78d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:00.662013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98d73d-6cd8-4327-aa1a-2e998ab78d6d None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:00.662662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98d73d-6cd8-4327-aa1a-2e998ab78d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:00.663143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98d73d-6cd8-4327-aa1a-2e998ab78d6d None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/3a90574a4a3141b1a90f1080c6072b31/roles/d228c647a46049f6899439970c288c22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:00.673490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:00.679671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65749272-d4ef-4dec-a053-134d29a512f5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:00.692279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98d73d-6cd8-4327-aa1a-2e998ab78d6d None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=3a90574a4a3141b1a90f1080c6072b31, role_id=d228c647a46049f6899439970c288c22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:00.694227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98d73d-6cd8-4327-aa1a-2e998ab78d6d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:00.710135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 409/830] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:22:00 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/3a90574a4a3141b1a90f1080c6072b31/roles/d228c647a46049f6899439970c288c22 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:22:00.710972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98d73d-6cd8-4327-aa1a-2e998ab78d6d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:00.713501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:00.730125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f12b3-2724-49d4-85ff-89a1b0fbccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:00.731315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f12b3-2724-49d4-85ff-89a1b0fbccf0 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:00.731740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f12b3-2724-49d4-85ff-89a1b0fbccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:00.732164 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f12b3-2724-49d4-85ff-89a1b0fbccf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:00.733087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f12b3-2724-49d4-85ff-89a1b0fbccf0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:00.734927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f12b3-2724-49d4-85ff-89a1b0fbccf0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:00.767824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 422/831] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:22:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:00.845878 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98d73d-6cd8-4327-aa1a-2e998ab78d6d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:00.892369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86835ac-25d8-4b8e-9fbe-bc4bfdc9480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:00.892988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86835ac-25d8-4b8e-9fbe-bc4bfdc9480e None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:00.893264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86835ac-25d8-4b8e-9fbe-bc4bfdc9480e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:00.893533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86835ac-25d8-4b8e-9fbe-bc4bfdc9480e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:00.894203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86835ac-25d8-4b8e-9fbe-bc4bfdc9480e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:00.896527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86835ac-25d8-4b8e-9fbe-bc4bfdc9480e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:00.922146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 410/832] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:22:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:01.732019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c754522-b350-4b97-b470-798abddbc740 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:01.732539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c754522-b350-4b97-b470-798abddbc740 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:01.732539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c754522-b350-4b97-b470-798abddbc740 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:01.734012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 423/833] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:01.739664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024cb71-aecc-44fa-bcc4-a06adb156344 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:01.740067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024cb71-aecc-44fa-bcc4-a06adb156344 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:01.740257 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024cb71-aecc-44fa-bcc4-a06adb156344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:01.760054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9024cb71-aecc-44fa-bcc4-a06adb156344 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:01.761252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9024cb71-aecc-44fa-bcc4-a06adb156344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:01.935479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:01.956427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 411/834] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:02.222605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c754522-b350-4b97-b470-798abddbc740 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:02.329672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c754522-b350-4b97-b470-798abddbc740 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:02.364368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25051ff9-f54f-42d5-a39e-20853348976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:02.365329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051ff9-f54f-42d5-a39e-20853348976f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:02.365831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051ff9-f54f-42d5-a39e-20853348976f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:02.366339 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051ff9-f54f-42d5-a39e-20853348976f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:02.377127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25051ff9-f54f-42d5-a39e-20853348976f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-25051ff9-f54f-42d5-a39e-20853348976f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:02.382449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:02.383405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:22:02.384249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:02.386814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 424/835] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:22:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:02.398007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024cb71-aecc-44fa-bcc4-a06adb156344 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:02.495381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024cb71-aecc-44fa-bcc4-a06adb156344 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:02.529217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a14d-0934-4a8c-86c0-89f1efe10647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:02.529818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a14d-0934-4a8c-86c0-89f1efe10647 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:02.530094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a14d-0934-4a8c-86c0-89f1efe10647 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:02.530364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a14d-0934-4a8c-86c0-89f1efe10647 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:02.531045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a14d-0934-4a8c-86c0-89f1efe10647 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:02.531343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a14d-0934-4a8c-86c0-89f1efe10647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:02.532693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a14d-0934-4a8c-86c0-89f1efe10647 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:02.542510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 412/836] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:02.547965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25051ff9-f54f-42d5-a39e-20853348976f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:02.563358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:02.654896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25051ff9-f54f-42d5-a39e-20853348976f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:02.690052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73714953-1d47-44a3-b8a3-3d80b02cb30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:02.690994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714953-1d47-44a3-b8a3-3d80b02cb30d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:02.692014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714953-1d47-44a3-b8a3-3d80b02cb30d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:02.692438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714953-1d47-44a3-b8a3-3d80b02cb30d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:02.703592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73714953-1d47-44a3-b8a3-3d80b02cb30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:02.705251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73714953-1d47-44a3-b8a3-3d80b02cb30d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-73714953-1d47-44a3-b8a3-3d80b02cb30d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:02.720019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:02.721202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:02.722289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:02.722289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:02.722289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:02.724720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 425/837] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:02.734772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a14d-0934-4a8c-86c0-89f1efe10647 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:02.774783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:02.839385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a14d-0934-4a8c-86c0-89f1efe10647 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:02.875964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03ad9-4287-422c-b242-819bbf199bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:02.876564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03ad9-4287-422c-b242-819bbf199bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:02.876840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03ad9-4287-422c-b242-819bbf199bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:02.877108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03ad9-4287-422c-b242-819bbf199bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:02.877738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03ad9-4287-422c-b242-819bbf199bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:02.878038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03ad9-4287-422c-b242-819bbf199bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:02.879612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03ad9-4287-422c-b242-819bbf199bd0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:02.891452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 413/838] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:02.897247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73714953-1d47-44a3-b8a3-3d80b02cb30d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:02.961181 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693618-fa78-49f2-877c-9b33de6afb38 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:02.961502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693618-fa78-49f2-877c-9b33de6afb38 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:02.962317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693618-fa78-49f2-877c-9b33de6afb38 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:02.966953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 414/839] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:02.968047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247358-2d65-4380-ac76-169fdb326851 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:02.968331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247358-2d65-4380-ac76-169fdb326851 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:02.968606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247358-2d65-4380-ac76-169fdb326851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:02.969390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:02.989498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e0247358-2d65-4380-ac76-169fdb326851 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:02.990831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e0247358-2d65-4380-ac76-169fdb326851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:03.009633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73714953-1d47-44a3-b8a3-3d80b02cb30d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:03.046953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1efab-ad41-4b79-96d4-d1feb4df1265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:03.047918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1efab-ad41-4b79-96d4-d1feb4df1265 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.048417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1efab-ad41-4b79-96d4-d1feb4df1265 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.048884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1efab-ad41-4b79-96d4-d1feb4df1265 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.059118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1efab-ad41-4b79-96d4-d1feb4df1265 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:03.061947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1efab-ad41-4b79-96d4-d1feb4df1265 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:03.071136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 415/840] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-b9b1efab-ad41-4b79-96d4-d1feb4df1265 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:22:03.076854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:03.077889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:03.079289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:03.079289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:03.079289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:22:03.079289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:22:03.079289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:22:03.079289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:22:03.079289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:22:03.079289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:22:03.079289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:22:03.079289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:03.082478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 426/841] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:22:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:03.088110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0247358-2d65-4380-ac76-169fdb326851 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:03.121948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:03.193818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0247358-2d65-4380-ac76-169fdb326851 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:03.194013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fd474-9b5c-49f7-8787-b716e380b2c6 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.194245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fd474-9b5c-49f7-8787-b716e380b2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.194484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fd474-9b5c-49f7-8787-b716e380b2c6 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.197169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 427/842] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:03.201338 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36434ad8-3437-4c40-ac8d-cb0e91fe057d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.201626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36434ad8-3437-4c40-ac8d-cb0e91fe057d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.201921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36434ad8-3437-4c40-ac8d-cb0e91fe057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.220223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-36434ad8-3437-4c40-ac8d-cb0e91fe057d None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:03.221638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-36434ad8-3437-4c40-ac8d-cb0e91fe057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:03.229624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57879982-4e72-4307-964d-6bfbb0c5a895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:03.230224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879982-4e72-4307-964d-6bfbb0c5a895 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.230503 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879982-4e72-4307-964d-6bfbb0c5a895 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.230803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879982-4e72-4307-964d-6bfbb0c5a895 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.231523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57879982-4e72-4307-964d-6bfbb0c5a895 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:03.231825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57879982-4e72-4307-964d-6bfbb0c5a895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:03.233227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57879982-4e72-4307-964d-6bfbb0c5a895 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:03.253418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 416/843] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Oct 4 08:22:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:03.254940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68668e-9852-4a4f-9b26-42cf16eaf494 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.255295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68668e-9852-4a4f-9b26-42cf16eaf494 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.255576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68668e-9852-4a4f-9b26-42cf16eaf494 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.256918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 417/844] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:03.259759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68668e-9852-4a4f-9b26-42cf16eaf494 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:03.298346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 428/845] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:03.299974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa15f5-0aa3-45a9-b86d-94869e7b028c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.300772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa15f5-0aa3-45a9-b86d-94869e7b028c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.301426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa15f5-0aa3-45a9-b86d-94869e7b028c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.319408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-11aa15f5-0aa3-45a9-b86d-94869e7b028c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:03.320903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-11aa15f5-0aa3-45a9-b86d-94869e7b028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:03.360412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:03.371407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68668e-9852-4a4f-9b26-42cf16eaf494 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:03.377518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:03.400232 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 429/846] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:03.401741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa15f5-0aa3-45a9-b86d-94869e7b028c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:03.413185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb64a7e-281f-4554-bf6a-e569cc135775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:03.413899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64a7e-281f-4554-bf6a-e569cc135775 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.414543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64a7e-281f-4554-bf6a-e569cc135775 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.414936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64a7e-281f-4554-bf6a-e569cc135775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.496005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb64a7e-281f-4554-bf6a-e569cc135775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:03.497587 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb64a7e-281f-4554-bf6a-e569cc135775 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:03.539528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa15f5-0aa3-45a9-b86d-94869e7b028c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:03.585279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd78c2-2610-4d12-a509-39ba7ebfd1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:03.586253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd78c2-2610-4d12-a509-39ba7ebfd1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.586532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd78c2-2610-4d12-a509-39ba7ebfd1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.586977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd78c2-2610-4d12-a509-39ba7ebfd1e8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.587570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd78c2-2610-4d12-a509-39ba7ebfd1e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:03.588948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd78c2-2610-4d12-a509-39ba7ebfd1e8 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:03.597911 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-dedd78c2-2610-4d12-a509-39ba7ebfd1e8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:03.598068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:03.601384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:03.603135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 430/847] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Oct 4 08:22:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:03.604212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd78c2-2610-4d12-a509-39ba7ebfd1e8 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:03.619754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 418/848] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:22:03.620733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb64a7e-281f-4554-bf6a-e569cc135775 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:03.658726 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:03.712967 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd78c2-2610-4d12-a509-39ba7ebfd1e8 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:03.720455 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb64a7e-281f-4554-bf6a-e569cc135775 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:03.748416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd58624-745a-4963-a8dd-08868cb99805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:03.749271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd58624-745a-4963-a8dd-08868cb99805 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.749549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd58624-745a-4963-a8dd-08868cb99805 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.749822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd58624-745a-4963-a8dd-08868cb99805 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.750397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd58624-745a-4963-a8dd-08868cb99805 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:03.751787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd58624-745a-4963-a8dd-08868cb99805 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:03.755122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ca8a1-8de0-4406-9585-d1ed41d7d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:03.755805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ca8a1-8de0-4406-9585-d1ed41d7d272 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.756159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ca8a1-8de0-4406-9585-d1ed41d7d272 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.756507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ca8a1-8de0-4406-9585-d1ed41d7d272 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.757203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ca8a1-8de0-4406-9585-d1ed41d7d272 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:03.757582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ca8a1-8de0-4406-9585-d1ed41d7d272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:03.759035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ca8a1-8de0-4406-9585-d1ed41d7d272 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-edd58624-745a-4963-a8dd-08868cb99805 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:03.760864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:03.767007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:03.768011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 431/849] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:22:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:03.768987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd58624-745a-4963-a8dd-08868cb99805 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:03.769071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 419/850] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:03.769071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ca8a1-8de0-4406-9585-d1ed41d7d272 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:03.824073 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:03.862174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd58624-745a-4963-a8dd-08868cb99805 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:03.871505 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ca8a1-8de0-4406-9585-d1ed41d7d272 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:03.876072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:03.898419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77b681-57d6-472a-a45c-6a1ed629a5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:03.899077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b681-57d6-472a-a45c-6a1ed629a5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.899355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b681-57d6-472a-a45c-6a1ed629a5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.899624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b681-57d6-472a-a45c-6a1ed629a5c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.905681 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49761d0a-0d35-4fd0-bccb-c5f23341b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:03.906298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49761d0a-0d35-4fd0-bccb-c5f23341b732 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:03.906573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49761d0a-0d35-4fd0-bccb-c5f23341b732 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:03.906870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49761d0a-0d35-4fd0-bccb-c5f23341b732 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:03.910522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77b681-57d6-472a-a45c-6a1ed629a5c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:03.912088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77b681-57d6-472a-a45c-6a1ed629a5c7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:03.917392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49761d0a-0d35-4fd0-bccb-c5f23341b732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-49761d0a-0d35-4fd0-bccb-c5f23341b732 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:03.922109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:03.923256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 420/851] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:22:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:03.924324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49761d0a-0d35-4fd0-bccb-c5f23341b732 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2b77b681-57d6-472a-a45c-6a1ed629a5c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:03.927059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:03.927973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:03.929484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:03.929484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:03.929484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:03.930807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 432/852] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:03.931819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77b681-57d6-472a-a45c-6a1ed629a5c7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.026215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49761d0a-0d35-4fd0-bccb-c5f23341b732 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:04.027926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77b681-57d6-472a-a45c-6a1ed629a5c7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:04.040468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:04.061228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecbaed-36df-47bb-9ac0-6ae5cb8478b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:04.061830 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecbaed-36df-47bb-9ac0-6ae5cb8478b9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:04.062104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520b9a3-08c3-4bff-b957-8f3e75058aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:04.062214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecbaed-36df-47bb-9ac0-6ae5cb8478b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:04.062376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecbaed-36df-47bb-9ac0-6ae5cb8478b9 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:04.062728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520b9a3-08c3-4bff-b957-8f3e75058aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:04.063012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520b9a3-08c3-4bff-b957-8f3e75058aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:04.063103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecbaed-36df-47bb-9ac0-6ae5cb8478b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:04.063287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520b9a3-08c3-4bff-b957-8f3e75058aa1 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:04.063388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecbaed-36df-47bb-9ac0-6ae5cb8478b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:04.063909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520b9a3-08c3-4bff-b957-8f3e75058aa1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:04.064211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520b9a3-08c3-4bff-b957-8f3e75058aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:04.064669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecbaed-36df-47bb-9ac0-6ae5cb8478b9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:04.065553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520b9a3-08c3-4bff-b957-8f3e75058aa1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:04.069027 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 421/853] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:22:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:04.069794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecbaed-36df-47bb-9ac0-6ae5cb8478b9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.078832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 433/854] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:04.078832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520b9a3-08c3-4bff-b957-8f3e75058aa1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.111879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:04.186153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecbaed-36df-47bb-9ac0-6ae5cb8478b9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:04.198903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520b9a3-08c3-4bff-b957-8f3e75058aa1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:04.226097 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accb0e7-1e22-4c57-87c2-cf546ad10de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:04.226961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accb0e7-1e22-4c57-87c2-cf546ad10de3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:04.227362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accb0e7-1e22-4c57-87c2-cf546ad10de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:04.227631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accb0e7-1e22-4c57-87c2-cf546ad10de3 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:04.228307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accb0e7-1e22-4c57-87c2-cf546ad10de3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:04.228617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accb0e7-1e22-4c57-87c2-cf546ad10de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:04.230021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accb0e7-1e22-4c57-87c2-cf546ad10de3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:04.235363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cecb2-3471-4312-8cd9-acd9015a5d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:04.235974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cecb2-3471-4312-8cd9-acd9015a5d3c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:04.236250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cecb2-3471-4312-8cd9-acd9015a5d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:04.236518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cecb2-3471-4312-8cd9-acd9015a5d3c None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:04.237159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cecb2-3471-4312-8cd9-acd9015a5d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:04.237461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cecb2-3471-4312-8cd9-acd9015a5d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:04.239157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 422/855] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:22:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:04.239283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cecb2-3471-4312-8cd9-acd9015a5d3c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:04.246655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accb0e7-1e22-4c57-87c2-cf546ad10de3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.254250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 434/856] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:04.255072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cecb2-3471-4312-8cd9-acd9015a5d3c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.294309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:04.355771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:04.363863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accb0e7-1e22-4c57-87c2-cf546ad10de3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:04.371475 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cecb2-3471-4312-8cd9-acd9015a5d3c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:04.397545 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5baab1c-e5da-4f41-9687-2f8a08b0e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:04.398234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baab1c-e5da-4f41-9687-2f8a08b0e6cc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:04.398423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baab1c-e5da-4f41-9687-2f8a08b0e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:04.398714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baab1c-e5da-4f41-9687-2f8a08b0e6cc None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:04.399400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5baab1c-e5da-4f41-9687-2f8a08b0e6cc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:04.399671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5baab1c-e5da-4f41-9687-2f8a08b0e6cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:04.400968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5baab1c-e5da-4f41-9687-2f8a08b0e6cc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:04.410715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 423/857] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:22:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:04.410715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5baab1c-e5da-4f41-9687-2f8a08b0e6cc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.421101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dee5b9-0d0e-47e1-8ba3-641f6c133a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:04.421758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dee5b9-0d0e-47e1-8ba3-641f6c133a69 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:04.422037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dee5b9-0d0e-47e1-8ba3-641f6c133a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:04.422309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dee5b9-0d0e-47e1-8ba3-641f6c133a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:04.436637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dee5b9-0d0e-47e1-8ba3-641f6c133a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:04.438401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dee5b9-0d0e-47e1-8ba3-641f6c133a69 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d2dee5b9-0d0e-47e1-8ba3-641f6c133a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:04.462987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:04.464096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:04.465072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:04.465072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:04.465072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:04.467447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 435/858] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:04.475959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dee5b9-0d0e-47e1-8ba3-641f6c133a69 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.543875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5baab1c-e5da-4f41-9687-2f8a08b0e6cc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:04.547261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:04.589885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7207159-4a0b-4ad2-b8af-796b8f6c8ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:04.590540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7207159-4a0b-4ad2-b8af-796b8f6c8ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:04.590848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7207159-4a0b-4ad2-b8af-796b8f6c8ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:04.591118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7207159-4a0b-4ad2-b8af-796b8f6c8ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:04.601327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7207159-4a0b-4ad2-b8af-796b8f6c8ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:04.602532 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7207159-4a0b-4ad2-b8af-796b8f6c8ca0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b7207159-4a0b-4ad2-b8af-796b8f6c8ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:22:04.615546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:04.616507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:04.617404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:22:04.617404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:22:04.617404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:22:04.617404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:22:04.617404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:22:04.617404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:22:04.617404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:04.617404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:04.617858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 424/859] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:04.622705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dee5b9-0d0e-47e1-8ba3-641f6c133a69 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:04.623733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7207159-4a0b-4ad2-b8af-796b8f6c8ca0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.665056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1944-1d2c-4ea1-95b0-ce975c176ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:04.665814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1944-1d2c-4ea1-95b0-ce975c176ead None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:04.666182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1944-1d2c-4ea1-95b0-ce975c176ead None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:04.666547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1944-1d2c-4ea1-95b0-ce975c176ead None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:04.667331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c1944-1d2c-4ea1-95b0-ce975c176ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:04.667735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c1944-1d2c-4ea1-95b0-ce975c176ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:04.669195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c1944-1d2c-4ea1-95b0-ce975c176ead None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:04.680672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:04.688968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 436/860] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:04.690004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1944-1d2c-4ea1-95b0-ce975c176ead None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.758079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7207159-4a0b-4ad2-b8af-796b8f6c8ca0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:04.804016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1944-1d2c-4ea1-95b0-ce975c176ead None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:04.807347 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e46ea0-ee3e-4542-baaf-ec9e0baaea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:04.807789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e46ea0-ee3e-4542-baaf-ec9e0baaea6e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:04.808062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e46ea0-ee3e-4542-baaf-ec9e0baaea6e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:04.808329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e46ea0-ee3e-4542-baaf-ec9e0baaea6e None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:04.809020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e46ea0-ee3e-4542-baaf-ec9e0baaea6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:04.809322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e46ea0-ee3e-4542-baaf-ec9e0baaea6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:04.813873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e46ea0-ee3e-4542-baaf-ec9e0baaea6e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:04.832135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 425/861] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:22:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:04.842706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e46ea0-ee3e-4542-baaf-ec9e0baaea6e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.845633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692318-b386-477f-9240-97d52d46162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:04.846514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692318-b386-477f-9240-97d52d46162a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:04.847071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692318-b386-477f-9240-97d52d46162a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:04.848503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692318-b386-477f-9240-97d52d46162a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:04.856443 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20692318-b386-477f-9240-97d52d46162a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:04.858244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20692318-b386-477f-9240-97d52d46162a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-20692318-b386-477f-9240-97d52d46162a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:22:04.870600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:04.871716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:04.873158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:04.873158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:04.873158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:22:04.873158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:22:04.873158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:22:04.873158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:22:04.873158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:22:04.873158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:22:04.873158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:22:04.873158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:04.873911 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:04.875650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 437/862] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Oct 4 08:22:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:04.881642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692318-b386-477f-9240-97d52d46162a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:04.955131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:04.965488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e46ea0-ee3e-4542-baaf-ec9e0baaea6e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:05.008241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3719-facb-49ef-bc16-67dba1bf180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:05.009003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3719-facb-49ef-bc16-67dba1bf180b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:05.009385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3719-facb-49ef-bc16-67dba1bf180b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:05.009881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3719-facb-49ef-bc16-67dba1bf180b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:05.010003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692318-b386-477f-9240-97d52d46162a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:05.010819 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e3719-facb-49ef-bc16-67dba1bf180b None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=ce739a6448604eae823fd285a0164b47) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:05.011230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e3719-facb-49ef-bc16-67dba1bf180b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:05.013727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e3719-facb-49ef-bc16-67dba1bf180b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:05.022821 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 426/863] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:04 2022] GET /identity/v3/role_assignments?user.id=ce739a6448604eae823fd285a0164b47&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:05.057704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123823-6c57-4a6f-bf26-19211a90815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:05.059946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123823-6c57-4a6f-bf26-19211a90815d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:05.060374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123823-6c57-4a6f-bf26-19211a90815d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:05.060790 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123823-6c57-4a6f-bf26-19211a90815d None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:05.061707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f123823-6c57-4a6f-bf26-19211a90815d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:05.062168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f123823-6c57-4a6f-bf26-19211a90815d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:05.063900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f123823-6c57-4a6f-bf26-19211a90815d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:05.084684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 438/864] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Oct 4 08:22:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:05.090764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3719-facb-49ef-bc16-67dba1bf180b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:05.196429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:05.211431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3719-facb-49ef-bc16-67dba1bf180b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:05.247039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac59d-e9dc-4516-8ca1-08a5020ebe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:05.247650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac59d-e9dc-4516-8ca1-08a5020ebe75 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:05.247931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac59d-e9dc-4516-8ca1-08a5020ebe75 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:05.248208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac59d-e9dc-4516-8ca1-08a5020ebe75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:05.320105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfac59d-e9dc-4516-8ca1-08a5020ebe75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:05.321613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfac59d-e9dc-4516-8ca1-08a5020ebe75 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:05.413221 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:05.431242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 427/865] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:22:05.432788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123823-6c57-4a6f-bf26-19211a90815d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:05.537159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123823-6c57-4a6f-bf26-19211a90815d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:05.555222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:05.574389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72287b6-b769-4fb6-a398-367279d3e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:05.575424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72287b6-b769-4fb6-a398-367279d3e073 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:05.575928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72287b6-b769-4fb6-a398-367279d3e073 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:05.576422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72287b6-b769-4fb6-a398-367279d3e073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:05.587125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72287b6-b769-4fb6-a398-367279d3e073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:05.588814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72287b6-b769-4fb6-a398-367279d3e073 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-a72287b6-b769-4fb6-a398-367279d3e073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:05.608535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:05.609532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:05.610489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:05.610489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:05.610489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:05.614444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 439/866] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:05.615854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac59d-e9dc-4516-8ca1-08a5020ebe75 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:05.718616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac59d-e9dc-4516-8ca1-08a5020ebe75 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:05.755090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632a3d-e5c1-43bb-a067-b7c9f94005bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:05.755625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632a3d-e5c1-43bb-a067-b7c9f94005bb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:05.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632a3d-e5c1-43bb-a067-b7c9f94005bb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:05.756175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632a3d-e5c1-43bb-a067-b7c9f94005bb None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:05.756812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632a3d-e5c1-43bb-a067-b7c9f94005bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:05.757119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632a3d-e5c1-43bb-a067-b7c9f94005bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:05.758492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632a3d-e5c1-43bb-a067-b7c9f94005bb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:05.774880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 428/867] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:05.776429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72287b6-b769-4fb6-a398-367279d3e073 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:05.887901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72287b6-b769-4fb6-a398-367279d3e073 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:05.923560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b294154-163c-4f44-a518-b72f17d09d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:05.924191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294154-163c-4f44-a518-b72f17d09d2b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:05.924470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294154-163c-4f44-a518-b72f17d09d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:05.924740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294154-163c-4f44-a518-b72f17d09d2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:05.932983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b294154-163c-4f44-a518-b72f17d09d2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:05.934431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b294154-163c-4f44-a518-b72f17d09d2b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-5b294154-163c-4f44-a518-b72f17d09d2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:22:05.946446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:05.947416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:05.948358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:22:05.948358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:22:05.948358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:22:05.948358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:22:05.948358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:22:05.948358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:22:05.948358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:05.948358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:05.948358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 440/868] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:05.953546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632a3d-e5c1-43bb-a067-b7c9f94005bb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:06.008958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:06.066443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632a3d-e5c1-43bb-a067-b7c9f94005bb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:06.103230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c74893-cf21-4ef0-a089-34379af7f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:06.104272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c74893-cf21-4ef0-a089-34379af7f192 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:06.104766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c74893-cf21-4ef0-a089-34379af7f192 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:06.105241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c74893-cf21-4ef0-a089-34379af7f192 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:06.106131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c74893-cf21-4ef0-a089-34379af7f192 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:06.106645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c74893-cf21-4ef0-a089-34379af7f192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:06.108319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c74893-cf21-4ef0-a089-34379af7f192 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:06.120988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 429/869] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:22:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:06.127266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b294154-163c-4f44-a518-b72f17d09d2b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:06.164423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:06.235974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b294154-163c-4f44-a518-b72f17d09d2b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:06.258488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e9ebd-6425-48a9-8fe5-9703d074f5ac None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:06.259204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e9ebd-6425-48a9-8fe5-9703d074f5ac None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:06.259816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e9ebd-6425-48a9-8fe5-9703d074f5ac None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:06.262151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 430/870] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:06.267670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f10669-f0c0-4dfc-8f4e-d35030887835 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:06.268532 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f10669-f0c0-4dfc-8f4e-d35030887835 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:06.269374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f10669-f0c0-4dfc-8f4e-d35030887835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:06.275738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda2d0f-b02a-4032-bb82-13e498a79809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:06.276337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda2d0f-b02a-4032-bb82-13e498a79809 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:06.276611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda2d0f-b02a-4032-bb82-13e498a79809 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:06.276878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda2d0f-b02a-4032-bb82-13e498a79809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:06.277625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda2d0f-b02a-4032-bb82-13e498a79809 None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=3a90574a4a3141b1a90f1080c6072b31) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:06.277937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda2d0f-b02a-4032-bb82-13e498a79809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:06.279793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda2d0f-b02a-4032-bb82-13e498a79809 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:06.285617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 441/871] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:06 2022] GET /identity/v3/role_assignments?user.id=3a90574a4a3141b1a90f1080c6072b31&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:06.300154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-44f10669-f0c0-4dfc-8f4e-d35030887835 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:06.301965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-44f10669-f0c0-4dfc-8f4e-d35030887835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:06.380410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 431/872] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:06.652047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda2d0f-b02a-4032-bb82-13e498a79809 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:06.756112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:06.763604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda2d0f-b02a-4032-bb82-13e498a79809 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:06.781417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4760f9-e17d-49ff-877a-4d2c3796a47d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:06.781722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4760f9-e17d-49ff-877a-4d2c3796a47d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:06.781978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4760f9-e17d-49ff-877a-4d2c3796a47d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:06.783623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 432/873] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:06.790140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcafd09-65aa-4b9a-9881-f55b574795c9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:06.790421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcafd09-65aa-4b9a-9881-f55b574795c9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:06.790725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcafd09-65aa-4b9a-9881-f55b574795c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:06.803625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65454d7-9241-41b5-b8f3-7b3a57666827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:06.804283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65454d7-9241-41b5-b8f3-7b3a57666827 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:06.804566 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65454d7-9241-41b5-b8f3-7b3a57666827 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:06.804837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65454d7-9241-41b5-b8f3-7b3a57666827 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:06.805488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65454d7-9241-41b5-b8f3-7b3a57666827 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:06.806875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65454d7-9241-41b5-b8f3-7b3a57666827 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:06.810809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4dcafd09-65aa-4b9a-9881-f55b574795c9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:06.812280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4dcafd09-65aa-4b9a-9881-f55b574795c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:06.826760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 442/874] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:22:06 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:06.862543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:06.917271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 433/875] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:06 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:07.184936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65454d7-9241-41b5-b8f3-7b3a57666827 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:07.296633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65454d7-9241-41b5-b8f3-7b3a57666827 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:07.334956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5577d-41e8-409d-a3c9-27e6695e76da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:07.335572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5577d-41e8-409d-a3c9-27e6695e76da None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:07.335853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5577d-41e8-409d-a3c9-27e6695e76da None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:07.336127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5577d-41e8-409d-a3c9-27e6695e76da None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:07.336772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5577d-41e8-409d-a3c9-27e6695e76da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:07.338138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5577d-41e8-409d-a3c9-27e6695e76da None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:07.356107 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 443/876] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:22:07 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:07.410636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b68ee-45ce-44b4-a39c-0e1f4133a4d2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:07.411663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b68ee-45ce-44b4-a39c-0e1f4133a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:07.412162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b68ee-45ce-44b4-a39c-0e1f4133a4d2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:07.414180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 434/877] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:07.420445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9d86d-6d70-402c-9f7b-d79ecf6d80d3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:07.421094 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9d86d-6d70-402c-9f7b-d79ecf6d80d3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:07.421574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9d86d-6d70-402c-9f7b-d79ecf6d80d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:07.444651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-17e9d86d-6d70-402c-9f7b-d79ecf6d80d3 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:07.445847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-17e9d86d-6d70-402c-9f7b-d79ecf6d80d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:07.457166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:07.529621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 444/878] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:07.798363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b68ee-45ce-44b4-a39c-0e1f4133a4d2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:07.904226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b68ee-45ce-44b4-a39c-0e1f4133a4d2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:07.938716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a59fd-2c06-4799-9845-b77725bb7d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:07.939356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a59fd-2c06-4799-9845-b77725bb7d19 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:07.939632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a59fd-2c06-4799-9845-b77725bb7d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:07.939901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a59fd-2c06-4799-9845-b77725bb7d19 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:07.940477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a59fd-2c06-4799-9845-b77725bb7d19 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:07.941841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a59fd-2c06-4799-9845-b77725bb7d19 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-113a59fd-2c06-4799-9845-b77725bb7d19 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:07.950547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:07.951612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:07.952603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 435/879] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:07.960117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9d86d-6d70-402c-9f7b-d79ecf6d80d3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:08.063149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9d86d-6d70-402c-9f7b-d79ecf6d80d3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:08.099611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e297b5e-e6ea-49a2-84b7-153b0e5c694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:08.100599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e297b5e-e6ea-49a2-84b7-153b0e5c694c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:08.101076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e297b5e-e6ea-49a2-84b7-153b0e5c694c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:08.101543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e297b5e-e6ea-49a2-84b7-153b0e5c694c None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:08.102378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e297b5e-e6ea-49a2-84b7-153b0e5c694c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:08.102909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e297b5e-e6ea-49a2-84b7-153b0e5c694c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:08.104451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e297b5e-e6ea-49a2-84b7-153b0e5c694c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:08.114773 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 445/880] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Oct 4 08:22:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:08.116843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a59fd-2c06-4799-9845-b77725bb7d19 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:08.176280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:08.225346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a59fd-2c06-4799-9845-b77725bb7d19 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:08.259704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b74040-c8e7-424b-9dbe-0b6702ce8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:08.260312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b74040-c8e7-424b-9dbe-0b6702ce8736 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:08.260588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b74040-c8e7-424b-9dbe-0b6702ce8736 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:08.260858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b74040-c8e7-424b-9dbe-0b6702ce8736 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:08.261551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b74040-c8e7-424b-9dbe-0b6702ce8736 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:08.261852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b74040-c8e7-424b-9dbe-0b6702ce8736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:08.263247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b74040-c8e7-424b-9dbe-0b6702ce8736 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:08.268331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 436/881] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Oct 4 08:22:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:08.651098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21b14-4ef9-4d57-90bd-ee6ac8aeec9b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:08.652156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21b14-4ef9-4d57-90bd-ee6ac8aeec9b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:08.652656 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21b14-4ef9-4d57-90bd-ee6ac8aeec9b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:08.654414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 446/882] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:08.660009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452eeba9-2e00-4ed0-bb55-09bd8091f072 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:08.660844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452eeba9-2e00-4ed0-bb55-09bd8091f072 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:08.661386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452eeba9-2e00-4ed0-bb55-09bd8091f072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:08.680246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-452eeba9-2e00-4ed0-bb55-09bd8091f072 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:08.681789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-452eeba9-2e00-4ed0-bb55-09bd8091f072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:08.751082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 437/883] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:09.022591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21b14-4ef9-4d57-90bd-ee6ac8aeec9b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:09.028052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:09.122820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd200db-0f4b-47c3-8eb0-543b37d7861f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.123231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd200db-0f4b-47c3-8eb0-543b37d7861f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.123417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd200db-0f4b-47c3-8eb0-543b37d7861f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.125020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 438/884] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:09.131031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7c9c-81d1-4e3a-a56c-494c8267a88f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.131313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7c9c-81d1-4e3a-a56c-494c8267a88f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.131583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7c9c-81d1-4e3a-a56c-494c8267a88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.133582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21b14-4ef9-4d57-90bd-ee6ac8aeec9b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:09.150560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1b1e7c9c-81d1-4e3a-a56c-494c8267a88f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:09.151791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1b1e7c9c-81d1-4e3a-a56c-494c8267a88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:09.169760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68046cac-cf4e-4f9d-b5a4-fc893ea0a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:09.170406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68046cac-cf4e-4f9d-b5a4-fc893ea0a67c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.170714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68046cac-cf4e-4f9d-b5a4-fc893ea0a67c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.170983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68046cac-cf4e-4f9d-b5a4-fc893ea0a67c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.173423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:09.182663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68046cac-cf4e-4f9d-b5a4-fc893ea0a67c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-68046cac-cf4e-4f9d-b5a4-fc893ea0a67c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:09.187584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:09.188756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:09.189636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 447/885] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Oct 4 08:22:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:09.195864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68046cac-cf4e-4f9d-b5a4-fc893ea0a67c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:09.246870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 439/886] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:09.271889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:09.313630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68046cac-cf4e-4f9d-b5a4-fc893ea0a67c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:09.350844 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d7623-12dc-4f91-9df1-80123520437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:09.351750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7623-12dc-4f91-9df1-80123520437c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.352213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7623-12dc-4f91-9df1-80123520437c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.352667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7623-12dc-4f91-9df1-80123520437c None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.353541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d7623-12dc-4f91-9df1-80123520437c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:09.354025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d7623-12dc-4f91-9df1-80123520437c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:09.355595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d7623-12dc-4f91-9df1-80123520437c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:09.365155 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 448/887] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Oct 4 08:22:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:09.372679 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e7c9c-81d1-4e3a-a56c-494c8267a88f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:09.482723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e7c9c-81d1-4e3a-a56c-494c8267a88f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:09.525490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6b965-d426-4bbf-93bc-a34f406fd528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:09.526490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6b965-d426-4bbf-93bc-a34f406fd528 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.526997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6b965-d426-4bbf-93bc-a34f406fd528 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.527483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6b965-d426-4bbf-93bc-a34f406fd528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.528416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d7623-12dc-4f91-9df1-80123520437c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:09.542411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6b965-d426-4bbf-93bc-a34f406fd528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:09.544784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6b965-d426-4bbf-93bc-a34f406fd528 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fcb6b965-d426-4bbf-93bc-a34f406fd528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:09.567802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:09.568865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:09.569771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:09.569771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:09.569771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:09.570827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 440/888] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:09.574007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6b965-d426-4bbf-93bc-a34f406fd528 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:09.579197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:09.641114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d7623-12dc-4f91-9df1-80123520437c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:09.669691 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:09.682008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b1475-2e3a-4e66-b209-0306d22cbbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:09.682640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b1475-2e3a-4e66-b209-0306d22cbbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.682949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b1475-2e3a-4e66-b209-0306d22cbbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.683220 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b1475-2e3a-4e66-b209-0306d22cbbc9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.683807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b1475-2e3a-4e66-b209-0306d22cbbc9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:09.685181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b1475-2e3a-4e66-b209-0306d22cbbc9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-da5b1475-2e3a-4e66-b209-0306d22cbbc9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:09.694631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:09.695603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:09.701575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 449/889] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Oct 4 08:22:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:09.702924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7f606-2d9e-438c-9667-0612f2082141 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.702924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7f606-2d9e-438c-9667-0612f2082141 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.702924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7f606-2d9e-438c-9667-0612f2082141 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.702924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 450/890] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:09.703858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b873e-ac3c-4e64-ba9d-d31fe3f42416 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.704141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b873e-ac3c-4e64-ba9d-d31fe3f42416 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.704421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b873e-ac3c-4e64-ba9d-d31fe3f42416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.715070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6b965-d426-4bbf-93bc-a34f406fd528 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:09.721788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0e7b873e-ac3c-4e64-ba9d-d31fe3f42416 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:09.723087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0e7b873e-ac3c-4e64-ba9d-d31fe3f42416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:09.751294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845429-8b83-4f20-99b8-b7742cc678b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:09.752115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845429-8b83-4f20-99b8-b7742cc678b2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.752393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845429-8b83-4f20-99b8-b7742cc678b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.752666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845429-8b83-4f20-99b8-b7742cc678b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.753332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66845429-8b83-4f20-99b8-b7742cc678b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:09.754170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66845429-8b83-4f20-99b8-b7742cc678b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:09.755563 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66845429-8b83-4f20-99b8-b7742cc678b2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:09.767425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 441/891] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:09.768214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845429-8b83-4f20-99b8-b7742cc678b2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:09.801488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 451/892] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:09.803769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b873e-ac3c-4e64-ba9d-d31fe3f42416 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:09.837557 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:09.878587 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845429-8b83-4f20-99b8-b7742cc678b2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:09.915171 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b873e-ac3c-4e64-ba9d-d31fe3f42416 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:09.918456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4b9f8-195f-4fd3-afb8-b70d0d887b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:09.919320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4b9f8-195f-4fd3-afb8-b70d0d887b00 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.919793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4b9f8-195f-4fd3-afb8-b70d0d887b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.920237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4b9f8-195f-4fd3-afb8-b70d0d887b00 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.921102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4b9f8-195f-4fd3-afb8-b70d0d887b00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:09.921592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4b9f8-195f-4fd3-afb8-b70d0d887b00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:09.923672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4b9f8-195f-4fd3-afb8-b70d0d887b00 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:09.931582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 442/893] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:09.938777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4b9f8-195f-4fd3-afb8-b70d0d887b00 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:09.941850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:09.965074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ee84-4c4b-4b83-a70e-85037565e288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:09.965074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ee84-4c4b-4b83-a70e-85037565e288 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:09.965074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ee84-4c4b-4b83-a70e-85037565e288 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:09.965074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ee84-4c4b-4b83-a70e-85037565e288 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:09.973898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63ee84-4c4b-4b83-a70e-85037565e288 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:09.975077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63ee84-4c4b-4b83-a70e-85037565e288 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-aa63ee84-4c4b-4b83-a70e-85037565e288 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:22:09.986209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:09.987166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:09.988370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 452/894] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Oct 4 08:22:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:09.993341 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ee84-4c4b-4b83-a70e-85037565e288 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:10.080489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4b9f8-195f-4fd3-afb8-b70d0d887b00 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:10.110206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ee84-4c4b-4b83-a70e-85037565e288 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:10.114629 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:10.126766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52feab4-1655-4dee-a770-9043493da3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:10.127751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52feab4-1655-4dee-a770-9043493da3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.128035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52feab4-1655-4dee-a770-9043493da3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.128979 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52feab4-1655-4dee-a770-9043493da3e6 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.129612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52feab4-1655-4dee-a770-9043493da3e6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:10.130222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52feab4-1655-4dee-a770-9043493da3e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:10.131620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52feab4-1655-4dee-a770-9043493da3e6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:10.138441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 443/895] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:10.139341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52feab4-1655-4dee-a770-9043493da3e6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:10.152218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205282a-6c39-488c-8d81-3e22fcde3a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:10.152822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205282a-6c39-488c-8d81-3e22fcde3a10 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.153106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205282a-6c39-488c-8d81-3e22fcde3a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.153365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205282a-6c39-488c-8d81-3e22fcde3a10 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.154104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205282a-6c39-488c-8d81-3e22fcde3a10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:10.154442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205282a-6c39-488c-8d81-3e22fcde3a10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:10.155869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205282a-6c39-488c-8d81-3e22fcde3a10 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:10.174106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 453/896] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Oct 4 08:22:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:10.174887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205282a-6c39-488c-8d81-3e22fcde3a10 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:10.218851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:10.254038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52feab4-1655-4dee-a770-9043493da3e6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:10.283357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205282a-6c39-488c-8d81-3e22fcde3a10 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:10.290324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873e9b8-8cbf-4354-889b-f80c634ba5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:10.290970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873e9b8-8cbf-4354-889b-f80c634ba5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.291254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873e9b8-8cbf-4354-889b-f80c634ba5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.291520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873e9b8-8cbf-4354-889b-f80c634ba5f4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.292090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873e9b8-8cbf-4354-889b-f80c634ba5f4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:10.293462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873e9b8-8cbf-4354-889b-f80c634ba5f4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5873e9b8-8cbf-4354-889b-f80c634ba5f4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:10.302755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:10.303743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:10.304677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 444/897] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:22:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:10.305491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873e9b8-8cbf-4354-889b-f80c634ba5f4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:10.323707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78e77-3f1b-422d-8abe-efc4f3289af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:10.324473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78e77-3f1b-422d-8abe-efc4f3289af4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.324752 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78e77-3f1b-422d-8abe-efc4f3289af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.325283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78e77-3f1b-422d-8abe-efc4f3289af4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.325996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c78e77-3f1b-422d-8abe-efc4f3289af4 None admin] RBAC: Adding query filter params (interface=public, service_id=e717103ff4034639801b3ba23447f939, region_id=RegionOne) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:10.326303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c78e77-3f1b-422d-8abe-efc4f3289af4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:10.327688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c78e77-3f1b-422d-8abe-efc4f3289af4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:10.333445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 454/898] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Oct 4 08:22:10 2022] GET /identity/v3/endpoints?service_id=e717103ff4034639801b3ba23447f939&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:10.334247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78e77-3f1b-422d-8abe-efc4f3289af4 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:10.367837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:10.413567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873e9b8-8cbf-4354-889b-f80c634ba5f4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:10.440431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78e77-3f1b-422d-8abe-efc4f3289af4 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:10.442963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:10.456749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8887b2-2099-448e-86a6-0be4e0a41651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:10.457781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8887b2-2099-448e-86a6-0be4e0a41651 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.458262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8887b2-2099-448e-86a6-0be4e0a41651 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.458765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8887b2-2099-448e-86a6-0be4e0a41651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.489346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f21fc-2b12-4558-94c2-8287b5860f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:10.489958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f21fc-2b12-4558-94c2-8287b5860f55 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.490233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f21fc-2b12-4558-94c2-8287b5860f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.490506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f21fc-2b12-4558-94c2-8287b5860f55 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.491164 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f21fc-2b12-4558-94c2-8287b5860f55 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:10.491570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f21fc-2b12-4558-94c2-8287b5860f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:10.492823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f21fc-2b12-4558-94c2-8287b5860f55 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:10.498446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 455/899] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:22:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:10.504666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f21fc-2b12-4558-94c2-8287b5860f55 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:10.532394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8887b2-2099-448e-86a6-0be4e0a41651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:10.533883 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8887b2-2099-448e-86a6-0be4e0a41651 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:10.588052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:10.603820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f21fc-2b12-4558-94c2-8287b5860f55 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:10.632235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 445/900] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:10 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:22:10.633005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8887b2-2099-448e-86a6-0be4e0a41651 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:10.637151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995d1aa-83c6-4c4b-b1b6-98beb1f05d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:10.637765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995d1aa-83c6-4c4b-b1b6-98beb1f05d9c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.638114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995d1aa-83c6-4c4b-b1b6-98beb1f05d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.638381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995d1aa-83c6-4c4b-b1b6-98beb1f05d9c None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.639007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995d1aa-83c6-4c4b-b1b6-98beb1f05d9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:10.640356 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995d1aa-83c6-4c4b-b1b6-98beb1f05d9c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:10.646001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 456/901] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Oct 4 08:22:10 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:22:10.647040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ac07f-3c92-42e7-90d2-fc76beeb61e8 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.647318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ac07f-3c92-42e7-90d2-fc76beeb61e8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.647587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ac07f-3c92-42e7-90d2-fc76beeb61e8 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.648758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 457/902] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:10.649459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ac07f-3c92-42e7-90d2-fc76beeb61e8 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:10.684290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:10.764544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8887b2-2099-448e-86a6-0be4e0a41651 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:10.765802 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ac07f-3c92-42e7-90d2-fc76beeb61e8 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:10.804338 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf06841-2b5a-454c-afd2-3cd16862a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:10.804987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf06841-2b5a-454c-afd2-3cd16862a2ca None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.805270 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf06841-2b5a-454c-afd2-3cd16862a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.805545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf06841-2b5a-454c-afd2-3cd16862a2ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.810716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404e4dc-4d41-48d3-ba73-9adba509d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:10.811334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404e4dc-4d41-48d3-ba73-9adba509d42f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.811613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404e4dc-4d41-48d3-ba73-9adba509d42f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.811882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404e4dc-4d41-48d3-ba73-9adba509d42f None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.812981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404e4dc-4d41-48d3-ba73-9adba509d42f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:10.813297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404e4dc-4d41-48d3-ba73-9adba509d42f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:10.815260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404e4dc-4d41-48d3-ba73-9adba509d42f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:10.816744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf06841-2b5a-454c-afd2-3cd16862a2ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:10.818194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf06841-2b5a-454c-afd2-3cd16862a2ca None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:10.826512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 446/903] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:22:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:10.827781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32810-c400-4838-855a-8508279377a9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:10.828076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32810-c400-4838-855a-8508279377a9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:10.828358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32810-c400-4838-855a-8508279377a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2bf06841-2b5a-454c-afd2-3cd16862a2ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:10.838472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:10.839515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:10.840423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:10.840423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:10.840423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:10.840423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 458/904] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:10.840660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf06841-2b5a-454c-afd2-3cd16862a2ca None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:10.848518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-56e32810-c400-4838-855a-8508279377a9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:10.849729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-56e32810-c400-4838-855a-8508279377a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:10.864743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:10.926827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 447/905] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:10.926827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e32810-c400-4838-855a-8508279377a9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:10.943361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:10.965310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf06841-2b5a-454c-afd2-3cd16862a2ca None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:11.002626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5a31-6a3b-40c2-9533-30b6587f6143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:11.003690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5a31-6a3b-40c2-9533-30b6587f6143 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:11.004245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5a31-6a3b-40c2-9533-30b6587f6143 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:11.004519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5a31-6a3b-40c2-9533-30b6587f6143 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:11.005226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a5a31-6a3b-40c2-9533-30b6587f6143 None admin] RBAC: Adding query filter params (interface=public, service_id=99c004235e2e4f28b65c3342ab97ff0d, region_id=RegionOne) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:11.005537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a5a31-6a3b-40c2-9533-30b6587f6143 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:11.006932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a5a31-6a3b-40c2-9533-30b6587f6143 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:11.012869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 459/906] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Oct 4 08:22:10 2022] GET /identity/v3/endpoints?service_id=99c004235e2e4f28b65c3342ab97ff0d&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:11.018350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5a31-6a3b-40c2-9533-30b6587f6143 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:11.054270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e32810-c400-4838-855a-8508279377a9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:11.093809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b9203-64a9-4969-a0ae-4728aaff5dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:11.094417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9203-64a9-4969-a0ae-4728aaff5dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:11.094725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9203-64a9-4969-a0ae-4728aaff5dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:11.095004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9203-64a9-4969-a0ae-4728aaff5dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:11.095647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9203-64a9-4969-a0ae-4728aaff5dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:11.095948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9203-64a9-4969-a0ae-4728aaff5dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:11.098049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9203-64a9-4969-a0ae-4728aaff5dc1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:11.111459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 448/907] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:11.119788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b9203-64a9-4969-a0ae-4728aaff5dc1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:11.137627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:11.154374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5a31-6a3b-40c2-9533-30b6587f6143 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:11.194367 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4187-ff27-454e-876e-7ed7bb27f182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:11.195087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4187-ff27-454e-876e-7ed7bb27f182 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:11.195374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4187-ff27-454e-876e-7ed7bb27f182 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:11.195646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4187-ff27-454e-876e-7ed7bb27f182 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:11.196252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db4187-ff27-454e-876e-7ed7bb27f182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:11.198380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db4187-ff27-454e-876e-7ed7bb27f182 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:11.205207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 460/908] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Oct 4 08:22:11 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:22:11.220549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4187-ff27-454e-876e-7ed7bb27f182 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:11.241026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:11.266214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b9203-64a9-4969-a0ae-4728aaff5dc1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:11.318015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f97864-cda3-49b8-814b-fd8b7a4d5991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:11.318858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97864-cda3-49b8-814b-fd8b7a4d5991 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:11.319147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97864-cda3-49b8-814b-fd8b7a4d5991 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:11.319419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97864-cda3-49b8-814b-fd8b7a4d5991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:11.329783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f97864-cda3-49b8-814b-fd8b7a4d5991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:11.331819 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f97864-cda3-49b8-814b-fd8b7a4d5991 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-02f97864-cda3-49b8-814b-fd8b7a4d5991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:22:11.349194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:11.350155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:11.351084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:22:11.351084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:22:11.351084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:22:11.351084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:22:11.351084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:22:11.351084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:22:11.351084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:11.351084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:11.354784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 449/909] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:11.358267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f97864-cda3-49b8-814b-fd8b7a4d5991 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:11.371311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4187-ff27-454e-876e-7ed7bb27f182 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:11.420060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff0e69-c34e-450e-8786-f3600dac944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:11.420666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff0e69-c34e-450e-8786-f3600dac944a None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:11.420942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff0e69-c34e-450e-8786-f3600dac944a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:11.421397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff0e69-c34e-450e-8786-f3600dac944a None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:11.422261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff0e69-c34e-450e-8786-f3600dac944a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:11.424059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff0e69-c34e-450e-8786-f3600dac944a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:11.445445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 461/910] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:22:11 2022] POST /identity/v3/services => generated 241 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:22:11.447080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:11.494828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f97864-cda3-49b8-814b-fd8b7a4d5991 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:11.540992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295eebfe-0177-433c-874a-5e7ab7444a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:11.541661 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eebfe-0177-433c-874a-5e7ab7444a44 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:11.541940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eebfe-0177-433c-874a-5e7ab7444a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:11.542205 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eebfe-0177-433c-874a-5e7ab7444a44 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:11.542977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eebfe-0177-433c-874a-5e7ab7444a44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:11.543285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eebfe-0177-433c-874a-5e7ab7444a44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:11.544749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eebfe-0177-433c-874a-5e7ab7444a44 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:11.559676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 450/911] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:22:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:11.567147 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff0e69-c34e-450e-8786-f3600dac944a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:11.650890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:11.684875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff0e69-c34e-450e-8786-f3600dac944a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:11.720091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cc9d7-777c-4e1d-8a51-ecd4e643ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:11.720620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc9d7-777c-4e1d-8a51-ecd4e643ec7f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:11.720894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc9d7-777c-4e1d-8a51-ecd4e643ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:11.721159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc9d7-777c-4e1d-8a51-ecd4e643ec7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:11.721883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cc9d7-777c-4e1d-8a51-ecd4e643ec7f None admin] RBAC: Adding query filter params (role.id=62b08115f7ca4b06851d82da540fc071, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=3a90574a4a3141b1a90f1080c6072b31) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:11.722817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cc9d7-777c-4e1d-8a51-ecd4e643ec7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:11.724370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cc9d7-777c-4e1d-8a51-ecd4e643ec7f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:11.730441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 462/912] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:11 2022] GET /identity/v3/role_assignments?user.id=3a90574a4a3141b1a90f1080c6072b31&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=62b08115f7ca4b06851d82da540fc071 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:12.860639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c252-e481-42a3-babe-4d8ebde4fa82 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:12.861144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c252-e481-42a3-babe-4d8ebde4fa82 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:12.861144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c252-e481-42a3-babe-4d8ebde4fa82 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:12.863092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 451/913] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:12.868389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb12a92-8f99-4507-8f06-b28577274ca2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:12.868820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb12a92-8f99-4507-8f06-b28577274ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:12.869002 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb12a92-8f99-4507-8f06-b28577274ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:12.886985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0fb12a92-8f99-4507-8f06-b28577274ca2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:12.888155 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0fb12a92-8f99-4507-8f06-b28577274ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:12.963696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 463/914] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:13.233166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4c252-e481-42a3-babe-4d8ebde4fa82 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:13.353561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4c252-e481-42a3-babe-4d8ebde4fa82 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:13.385374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:13.395036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8749d0d-885d-44d7-8e4f-f42b984b5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:13.395737 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749d0d-885d-44d7-8e4f-f42b984b5756 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:13.396162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749d0d-885d-44d7-8e4f-f42b984b5756 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:13.396696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749d0d-885d-44d7-8e4f-f42b984b5756 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:13.397239 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8749d0d-885d-44d7-8e4f-f42b984b5756 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:13.398628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8749d0d-885d-44d7-8e4f-f42b984b5756 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f8749d0d-885d-44d7-8e4f-f42b984b5756 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:13.407914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:13.408875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:13.409934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 452/915] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Oct 4 08:22:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:13.417309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb12a92-8f99-4507-8f06-b28577274ca2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:13.491427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:13.494334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95a3d-6e40-4763-8b6a-2d6cedd1d7f9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:13.494668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95a3d-6e40-4763-8b6a-2d6cedd1d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:13.494925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95a3d-6e40-4763-8b6a-2d6cedd1d7f9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:13.496424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 453/916] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:13.502415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994251aa-d399-435d-b3bf-43d0cb44aae6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:13.503015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994251aa-d399-435d-b3bf-43d0cb44aae6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:13.504035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994251aa-d399-435d-b3bf-43d0cb44aae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:13.523294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-994251aa-d399-435d-b3bf-43d0cb44aae6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:13.524906 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-994251aa-d399-435d-b3bf-43d0cb44aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:13.538174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb12a92-8f99-4507-8f06-b28577274ca2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:13.579431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f624719-15c9-4d95-a6e7-ad931cee0bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:13.580039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f624719-15c9-4d95-a6e7-ad931cee0bad None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:13.580316 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f624719-15c9-4d95-a6e7-ad931cee0bad None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:13.580588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f624719-15c9-4d95-a6e7-ad931cee0bad None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:13.581461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f624719-15c9-4d95-a6e7-ad931cee0bad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:13.581572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f624719-15c9-4d95-a6e7-ad931cee0bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:13.583426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f624719-15c9-4d95-a6e7-ad931cee0bad None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:13.593652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 464/917] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:13.594926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f624719-15c9-4d95-a6e7-ad931cee0bad None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:13.611695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 454/918] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:13.740234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f624719-15c9-4d95-a6e7-ad931cee0bad None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:13.767210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:13.775676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66251911-1586-4a0c-bae6-29b79fa9f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:13.776713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251911-1586-4a0c-bae6-29b79fa9f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:13.777426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251911-1586-4a0c-bae6-29b79fa9f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:13.777701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251911-1586-4a0c-bae6-29b79fa9f7b4 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:13.778329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66251911-1586-4a0c-bae6-29b79fa9f7b4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:13.778633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66251911-1586-4a0c-bae6-29b79fa9f7b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:13.780095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66251911-1586-4a0c-bae6-29b79fa9f7b4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:13.786111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 465/919] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:13.792104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994251aa-d399-435d-b3bf-43d0cb44aae6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:13.797490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757258ac-6a67-4d73-b81e-08110f8ce39a None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:13.797811 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757258ac-6a67-4d73-b81e-08110f8ce39a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:13.798024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757258ac-6a67-4d73-b81e-08110f8ce39a None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:13.799764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 466/920] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:13.808221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c8dfc-dc78-4755-8dd5-b952bef284fb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:13.808501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c8dfc-dc78-4755-8dd5-b952bef284fb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:13.808774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c8dfc-dc78-4755-8dd5-b952bef284fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:13.829955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b35c8dfc-dc78-4755-8dd5-b952bef284fb None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:13.831039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b35c8dfc-dc78-4755-8dd5-b952bef284fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:13.906111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 467/921] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:13.914331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c8dfc-dc78-4755-8dd5-b952bef284fb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:13.914580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994251aa-d399-435d-b3bf-43d0cb44aae6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:13.935531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:13.950685 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcefd6-7c01-40d2-a060-a837acf391d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:13.951302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcefd6-7c01-40d2-a060-a837acf391d7 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:13.951585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcefd6-7c01-40d2-a060-a837acf391d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:13.951861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcefd6-7c01-40d2-a060-a837acf391d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:13.952535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcefd6-7c01-40d2-a060-a837acf391d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:13.953910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcefd6-7c01-40d2-a060-a837acf391d7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:13.973654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 455/922] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:22:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:13.975067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4203-a9da-4631-9c0e-3910a3244312 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:13.975177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4203-a9da-4631-9c0e-3910a3244312 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:13.975528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4203-a9da-4631-9c0e-3910a3244312 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:13.976922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 456/923] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:13.982359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d76c-ffec-439d-89de-f10f51a77e97 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:13.982639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d76c-ffec-439d-89de-f10f51a77e97 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:13.983014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d76c-ffec-439d-89de-f10f51a77e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.003526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-37e0d76c-ffec-439d-89de-f10f51a77e97 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:14.005107 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-37e0d76c-ffec-439d-89de-f10f51a77e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:14.027137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c8dfc-dc78-4755-8dd5-b952bef284fb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:14.055381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:14.074971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd69d23-9edb-4b0a-a17c-450599ab30e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:14.076007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd69d23-9edb-4b0a-a17c-450599ab30e7 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:14.076464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd69d23-9edb-4b0a-a17c-450599ab30e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:14.076947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd69d23-9edb-4b0a-a17c-450599ab30e7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.077735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd69d23-9edb-4b0a-a17c-450599ab30e7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:14.079337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd69d23-9edb-4b0a-a17c-450599ab30e7 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0fd69d23-9edb-4b0a-a17c-450599ab30e7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:14.089554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:14.090613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:22:14.091476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:14.094463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 468/924] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:22:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:14.104421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 457/925] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:14.105357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd69d23-9edb-4b0a-a17c-450599ab30e7 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:14.211889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd69d23-9edb-4b0a-a17c-450599ab30e7 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:14.222246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0d76c-ffec-439d-89de-f10f51a77e97 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:14.252809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba2ced-2c8c-4ba6-9873-f59b4cbbe2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:14.253961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba2ced-2c8c-4ba6-9873-f59b4cbbe2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:14.254247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba2ced-2c8c-4ba6-9873-f59b4cbbe2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:14.254520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba2ced-2c8c-4ba6-9873-f59b4cbbe2d0 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.255201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba2ced-2c8c-4ba6-9873-f59b4cbbe2d0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:14.255545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba2ced-2c8c-4ba6-9873-f59b4cbbe2d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:14.257336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba2ced-2c8c-4ba6-9873-f59b4cbbe2d0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:14.262273 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 469/926] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:22:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:14.267652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba2ced-2c8c-4ba6-9873-f59b4cbbe2d0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:14.325640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:14.342847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0d76c-ffec-439d-89de-f10f51a77e97 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:14.350597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:14.385485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b68bf-059f-4e02-a325-98776b014da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:14.386119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b68bf-059f-4e02-a325-98776b014da5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:14.386395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b68bf-059f-4e02-a325-98776b014da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:14.386690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b68bf-059f-4e02-a325-98776b014da5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.387273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b68bf-059f-4e02-a325-98776b014da5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:14.388636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b68bf-059f-4e02-a325-98776b014da5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:14.389491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba2ced-2c8c-4ba6-9873-f59b4cbbe2d0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b80b68bf-059f-4e02-a325-98776b014da5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:14.397589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:14.398818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:14.399704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 458/927] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:14.400520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b68bf-059f-4e02-a325-98776b014da5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:14.429784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576cb2-e8f9-4162-bd6b-7e664dd49a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:14.430619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576cb2-e8f9-4162-bd6b-7e664dd49a84 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:14.430939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576cb2-e8f9-4162-bd6b-7e664dd49a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:14.431277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576cb2-e8f9-4162-bd6b-7e664dd49a84 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.431982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0576cb2-e8f9-4162-bd6b-7e664dd49a84 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:14.432355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0576cb2-e8f9-4162-bd6b-7e664dd49a84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:14.433981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0576cb2-e8f9-4162-bd6b-7e664dd49a84 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:14.439069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 470/928] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Oct 4 08:22:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:14.439678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576cb2-e8f9-4162-bd6b-7e664dd49a84 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:14.520410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b68bf-059f-4e02-a325-98776b014da5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:14.552291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576cb2-e8f9-4162-bd6b-7e664dd49a84 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:14.560129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da966a39-9389-4479-b513-6083dc52bd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:14.560759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da966a39-9389-4479-b513-6083dc52bd1a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:14.561038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da966a39-9389-4479-b513-6083dc52bd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:14.561312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da966a39-9389-4479-b513-6083dc52bd1a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.563318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:14.572567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da966a39-9389-4479-b513-6083dc52bd1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-da966a39-9389-4479-b513-6083dc52bd1a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:14.577869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:14.579033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 459/929] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Oct 4 08:22:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:14.580094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da966a39-9389-4479-b513-6083dc52bd1a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:14.594342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7074e-615a-407e-9b93-cb4d85f1bea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:14.594990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7074e-615a-407e-9b93-cb4d85f1bea3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:14.595272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7074e-615a-407e-9b93-cb4d85f1bea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:14.595546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7074e-615a-407e-9b93-cb4d85f1bea3 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.596173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7074e-615a-407e-9b93-cb4d85f1bea3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:14.596478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7074e-615a-407e-9b93-cb4d85f1bea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:14.598168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7074e-615a-407e-9b93-cb4d85f1bea3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:14.607806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 471/930] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Oct 4 08:22:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:14.607806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7074e-615a-407e-9b93-cb4d85f1bea3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:14.617600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:14.692345 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da966a39-9389-4479-b513-6083dc52bd1a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:14.718600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7074e-615a-407e-9b93-cb4d85f1bea3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:14.727104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820b4e-864a-4010-819f-349c7561c2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:14.727716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820b4e-864a-4010-819f-349c7561c2c5 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:14.727997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820b4e-864a-4010-819f-349c7561c2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:14.728292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820b4e-864a-4010-819f-349c7561c2c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.729042 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f820b4e-864a-4010-819f-349c7561c2c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:14.730533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f820b4e-864a-4010-819f-349c7561c2c5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:14.752677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 460/931] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:22:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:14.754033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820b4e-864a-4010-819f-349c7561c2c5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:14.773109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b5db7-2c8b-4b47-8f70-c113297144b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:14.773784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b5db7-2c8b-4b47-8f70-c113297144b5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:14.774067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b5db7-2c8b-4b47-8f70-c113297144b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:14.774344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b5db7-2c8b-4b47-8f70-c113297144b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.775054 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b5db7-2c8b-4b47-8f70-c113297144b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:14.775355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b5db7-2c8b-4b47-8f70-c113297144b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:14.776766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b5db7-2c8b-4b47-8f70-c113297144b5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:14.790712 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 472/932] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Oct 4 08:22:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:14.795379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b5db7-2c8b-4b47-8f70-c113297144b5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:14.830420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:14.891826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820b4e-864a-4010-819f-349c7561c2c5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:14.895024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:14.917756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b5db7-2c8b-4b47-8f70-c113297144b5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:14.931700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aa478-8fa1-4e1b-b9a8-13e6fd72b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:14.932506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa478-8fa1-4e1b-b9a8-13e6fd72b6dc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:14.932892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa478-8fa1-4e1b-b9a8-13e6fd72b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:14.933322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa478-8fa1-4e1b-b9a8-13e6fd72b6dc None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.934273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aa478-8fa1-4e1b-b9a8-13e6fd72b6dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:14.934699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aa478-8fa1-4e1b-b9a8-13e6fd72b6dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:14.936220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aa478-8fa1-4e1b-b9a8-13e6fd72b6dc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:14.941790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 461/933] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Oct 4 08:22:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:14.948044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aa478-8fa1-4e1b-b9a8-13e6fd72b6dc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:14.969934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928965e-e9dc-4586-87d2-2eda5dbeb9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:14.970570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928965e-e9dc-4586-87d2-2eda5dbeb9de None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:14.970973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928965e-e9dc-4586-87d2-2eda5dbeb9de None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:14.971275 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928965e-e9dc-4586-87d2-2eda5dbeb9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:14.985227 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928965e-e9dc-4586-87d2-2eda5dbeb9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:14.986783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928965e-e9dc-4586-87d2-2eda5dbeb9de None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-6928965e-e9dc-4586-87d2-2eda5dbeb9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:15.007419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:15.008405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:15.014208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:15.014208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:15.014208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:15.014208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 473/934] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:15.017515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928965e-e9dc-4586-87d2-2eda5dbeb9de None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:15.078949 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aa478-8fa1-4e1b-b9a8-13e6fd72b6dc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:15.120514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:15.122851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265509a-d70e-42a1-9bb4-0a2090f1fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:15.123473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265509a-d70e-42a1-9bb4-0a2090f1fb6c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:15.123817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265509a-d70e-42a1-9bb4-0a2090f1fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:15.124105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265509a-d70e-42a1-9bb4-0a2090f1fb6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:15.124810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265509a-d70e-42a1-9bb4-0a2090f1fb6c None admin] RBAC: Adding query filter params (interface=public, service_id=d4060ef954fa468796e78ab1df953212, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:15.125289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265509a-d70e-42a1-9bb4-0a2090f1fb6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:15.126843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265509a-d70e-42a1-9bb4-0a2090f1fb6c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:15.136741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 462/935] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Oct 4 08:22:14 2022] GET /identity/v3/endpoints?service_id=d4060ef954fa468796e78ab1df953212&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:15.139459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928965e-e9dc-4586-87d2-2eda5dbeb9de None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:15.142534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265509a-d70e-42a1-9bb4-0a2090f1fb6c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:15.163023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:15.176075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddc9af-0a42-4fda-84fe-f1f5b52392c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:15.176691 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddc9af-0a42-4fda-84fe-f1f5b52392c5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:15.176996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddc9af-0a42-4fda-84fe-f1f5b52392c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:15.177285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddc9af-0a42-4fda-84fe-f1f5b52392c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:15.177932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddc9af-0a42-4fda-84fe-f1f5b52392c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:15.178235 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddc9af-0a42-4fda-84fe-f1f5b52392c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:15.179629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddc9af-0a42-4fda-84fe-f1f5b52392c5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:15.192716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 474/936] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:15.198086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddc9af-0a42-4fda-84fe-f1f5b52392c5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:15.252737 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265509a-d70e-42a1-9bb4-0a2090f1fb6c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:15.292055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786bea8-a93e-425b-88b2-ec909b3c1f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:15.293030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786bea8-a93e-425b-88b2-ec909b3c1f3a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:15.293529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786bea8-a93e-425b-88b2-ec909b3c1f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:15.293995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786bea8-a93e-425b-88b2-ec909b3c1f3a None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:15.294826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786bea8-a93e-425b-88b2-ec909b3c1f3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:15.296597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786bea8-a93e-425b-88b2-ec909b3c1f3a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:15.309348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 463/937] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Oct 4 08:22:15 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:22:15.314224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddc9af-0a42-4fda-84fe-f1f5b52392c5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:15.357644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b0a3-61b7-434d-9dc1-613b04588a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:15.358290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b0a3-61b7-434d-9dc1-613b04588a2f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:15.358571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b0a3-61b7-434d-9dc1-613b04588a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:15.358872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b0a3-61b7-434d-9dc1-613b04588a2f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:15.368096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950b0a3-61b7-434d-9dc1-613b04588a2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:15.369589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950b0a3-61b7-434d-9dc1-613b04588a2f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-5950b0a3-61b7-434d-9dc1-613b04588a2f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:22:15.383720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:15.386524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:15.387485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 475/938] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Oct 4 08:22:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:15.394770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786bea8-a93e-425b-88b2-ec909b3c1f3a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:15.489489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:15.513289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786bea8-a93e-425b-88b2-ec909b3c1f3a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:15.549206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35b5d6-b3fa-4d4c-982d-87f448ded25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:15.549808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35b5d6-b3fa-4d4c-982d-87f448ded25b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:15.550893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35b5d6-b3fa-4d4c-982d-87f448ded25b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:15.551168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35b5d6-b3fa-4d4c-982d-87f448ded25b None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:15.551891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35b5d6-b3fa-4d4c-982d-87f448ded25b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:15.552194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35b5d6-b3fa-4d4c-982d-87f448ded25b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:15.553625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35b5d6-b3fa-4d4c-982d-87f448ded25b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:15.572367 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 464/939] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Oct 4 08:22:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:15.578142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b0a3-61b7-434d-9dc1-613b04588a2f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:15.582955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:15.688814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b0a3-61b7-434d-9dc1-613b04588a2f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:15.727276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cd34d-df63-4e09-9bfc-e990d5205ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:15.727922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cd34d-df63-4e09-9bfc-e990d5205ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:15.728201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cd34d-df63-4e09-9bfc-e990d5205ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:15.728472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cd34d-df63-4e09-9bfc-e990d5205ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:15.743100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cd34d-df63-4e09-9bfc-e990d5205ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:15.744639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cd34d-df63-4e09-9bfc-e990d5205ae1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-370cd34d-df63-4e09-9bfc-e990d5205ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:15.767505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:15.768484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:15.769423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:15.769423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:15.769423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:15.770219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 476/940] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:15.775092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35b5d6-b3fa-4d4c-982d-87f448ded25b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:15.889037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35b5d6-b3fa-4d4c-982d-87f448ded25b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:15.926439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e65f5a-1ab2-4fba-aa6b-06e610c3a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:15.927487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e65f5a-1ab2-4fba-aa6b-06e610c3a713 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:15.927975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e65f5a-1ab2-4fba-aa6b-06e610c3a713 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:15.928451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e65f5a-1ab2-4fba-aa6b-06e610c3a713 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:15.929323 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e65f5a-1ab2-4fba-aa6b-06e610c3a713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:15.929826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e65f5a-1ab2-4fba-aa6b-06e610c3a713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:15.931422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e65f5a-1ab2-4fba-aa6b-06e610c3a713 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:15.934237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:15.945498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 465/941] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:15.951735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cd34d-df63-4e09-9bfc-e990d5205ae1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:16.009042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:16.054643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cd34d-df63-4e09-9bfc-e990d5205ae1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:16.105023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c16455-3784-4a45-a6f9-3c27dc08f835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:16.105991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c16455-3784-4a45-a6f9-3c27dc08f835 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:16.106389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c16455-3784-4a45-a6f9-3c27dc08f835 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:16.106789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c16455-3784-4a45-a6f9-3c27dc08f835 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:16.116121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c16455-3784-4a45-a6f9-3c27dc08f835 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:16.117573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c16455-3784-4a45-a6f9-3c27dc08f835 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-07c16455-3784-4a45-a6f9-3c27dc08f835 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:22:16.130084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:16.131403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:16.132638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:22:16.132638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:22:16.132638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:22:16.132638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:22:16.132638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:22:16.132638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:22:16.132638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:16.132638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:16.132638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 477/942] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:16.137403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e65f5a-1ab2-4fba-aa6b-06e610c3a713 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:16.251152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e65f5a-1ab2-4fba-aa6b-06e610c3a713 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:16.286077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40caa2-d983-446d-8347-1feceb929fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:16.286713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40caa2-d983-446d-8347-1feceb929fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:16.287001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40caa2-d983-446d-8347-1feceb929fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:16.287273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40caa2-d983-446d-8347-1feceb929fb2 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:16.287964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40caa2-d983-446d-8347-1feceb929fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:16.288274 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40caa2-d983-446d-8347-1feceb929fb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:16.289710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40caa2-d983-446d-8347-1feceb929fb2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:16.303110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 466/943] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:22:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:16.309143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c16455-3784-4a45-a6f9-3c27dc08f835 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:16.313869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712dcce-6782-4f3c-a646-3ef62cd721de None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:16.314193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712dcce-6782-4f3c-a646-3ef62cd721de None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:16.314416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712dcce-6782-4f3c-a646-3ef62cd721de None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:16.316826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 467/944] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:16.322838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d24540-beab-4bff-a48a-a30f45d2939b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:16.323179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d24540-beab-4bff-a48a-a30f45d2939b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:16.323391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d24540-beab-4bff-a48a-a30f45d2939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:16.342972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-82d24540-beab-4bff-a48a-a30f45d2939b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:16.344150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-82d24540-beab-4bff-a48a-a30f45d2939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:16.405131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:16.423924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 468/945] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:16.438328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c16455-3784-4a45-a6f9-3c27dc08f835 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:16.455033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:16.476529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bc712-3ce6-4c9b-9392-a24b752a3a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:16.477441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bc712-3ce6-4c9b-9392-a24b752a3a0f None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:16.477981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bc712-3ce6-4c9b-9392-a24b752a3a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:16.478437 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bc712-3ce6-4c9b-9392-a24b752a3a0f None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/3a90574a4a3141b1a90f1080c6072b31/roles/62b08115f7ca4b06851d82da540fc071` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:16.480835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bc712-3ce6-4c9b-9392-a24b752a3a0f None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=3a90574a4a3141b1a90f1080c6072b31, role_id=62b08115f7ca4b06851d82da540fc071)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:16.482492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bc712-3ce6-4c9b-9392-a24b752a3a0f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:16.496798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 478/946] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:22:16 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/3a90574a4a3141b1a90f1080c6072b31/roles/62b08115f7ca4b06851d82da540fc071 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:22:16.715713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d24540-beab-4bff-a48a-a30f45d2939b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:16.820915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d24540-beab-4bff-a48a-a30f45d2939b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:16.857721 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a17d5-a1bc-4ceb-80c4-30f65cb78e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:16.858660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a17d5-a1bc-4ceb-80c4-30f65cb78e66 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:16.859175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a17d5-a1bc-4ceb-80c4-30f65cb78e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:16.859646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a17d5-a1bc-4ceb-80c4-30f65cb78e66 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:16.860471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a17d5-a1bc-4ceb-80c4-30f65cb78e66 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:16.862032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a17d5-a1bc-4ceb-80c4-30f65cb78e66 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-610a17d5-a1bc-4ceb-80c4-30f65cb78e66 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:16.872112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:16.873123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:22:16.873995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:16.876386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 469/947] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:16.885016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bc712-3ce6-4c9b-9392-a24b752a3a0f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:16.993398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bc712-3ce6-4c9b-9392-a24b752a3a0f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:17.028792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfea3f5-a1e8-47d3-a2d1-01df574f003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:17.029662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfea3f5-a1e8-47d3-a2d1-01df574f003b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:17.030093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfea3f5-a1e8-47d3-a2d1-01df574f003b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:17.030544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfea3f5-a1e8-47d3-a2d1-01df574f003b None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:17.031343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfea3f5-a1e8-47d3-a2d1-01df574f003b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:17.031817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfea3f5-a1e8-47d3-a2d1-01df574f003b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:17.033325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfea3f5-a1e8-47d3-a2d1-01df574f003b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:17.039550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 479/948] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:22:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:17.047820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a17d5-a1bc-4ceb-80c4-30f65cb78e66 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:17.098473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:17.161595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a17d5-a1bc-4ceb-80c4-30f65cb78e66 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:17.200581 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5620b8-1826-43e7-9aad-e5cf41ce5701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:17.201443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5620b8-1826-43e7-9aad-e5cf41ce5701 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:17.201905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5620b8-1826-43e7-9aad-e5cf41ce5701 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:17.202327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5620b8-1826-43e7-9aad-e5cf41ce5701 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:17.203150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5620b8-1826-43e7-9aad-e5cf41ce5701 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:17.203606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5620b8-1826-43e7-9aad-e5cf41ce5701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:17.205132 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5620b8-1826-43e7-9aad-e5cf41ce5701 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:17.211321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 470/949] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:22:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:17.288655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c559-c21a-4fc5-9fc2-bac62cea391e None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:17.289174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c559-c21a-4fc5-9fc2-bac62cea391e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:17.289623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c559-c21a-4fc5-9fc2-bac62cea391e None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:17.291739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 480/950] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:17.297956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b579fea-d101-4ecd-b6fb-2c4800269bf4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:17.298474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b579fea-d101-4ecd-b6fb-2c4800269bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:17.298940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b579fea-d101-4ecd-b6fb-2c4800269bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:17.319602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6b579fea-d101-4ecd-b6fb-2c4800269bf4 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:17.321339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6b579fea-d101-4ecd-b6fb-2c4800269bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:17.403580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 471/951] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:17.656694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564dc3-faec-4079-ae73-f5a2ec08bac4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:17.656895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564dc3-faec-4079-ae73-f5a2ec08bac4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:17.657163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564dc3-faec-4079-ae73-f5a2ec08bac4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:17.658850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 481/952] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:17.664740 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a06701-b7c1-4119-ae79-fa2cbae12b83 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:17.665039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a06701-b7c1-4119-ae79-fa2cbae12b83 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:17.665308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a06701-b7c1-4119-ae79-fa2cbae12b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:17.678528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6564dc3-faec-4079-ae73-f5a2ec08bac4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:17.684861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-25a06701-b7c1-4119-ae79-fa2cbae12b83 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:17.686050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-25a06701-b7c1-4119-ae79-fa2cbae12b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:17.728813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:17.743083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:17.782782 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 472/953] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:17.803210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6564dc3-faec-4079-ae73-f5a2ec08bac4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:17.838393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:17.839045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:17.839364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:17.839637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:17.840273 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:17.841763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:17.844497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WARNING keystone.server.flask.common [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 08:22:17.864854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.sql.core [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:22:17.864854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 08:22:17.864854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [parameters: {'id': '061f98fcb5ce4877bb308e6565291d49', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 08:22:17.864854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81399) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 061f98fcb5ce4877bb308e6565291d49.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 061f98fcb5ce4877bb308e6565291d49. Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:22:17.882261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application result.read() Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 08:22:17.883132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application yield resource Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise self.value Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application session.commit() Oct 04 08:22:17.884115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:22:17.885031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:22:17.885962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application result.read() Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:22:17.887781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [parameters: {'id': '061f98fcb5ce4877bb308e6565291d49', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:17.889144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:17.890119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:17.891280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:17.891280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 08:22:17.891280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 08:22:17.891280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:17.891280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:17.891280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 08:22:17.891280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 08:22:17.891280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 061f98fcb5ce4877bb308e6565291d49. Oct 04 08:22:17.891280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:17.891280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 482/954] 10.222.0.23 () {60 vars in 1140 bytes} [Tue Oct 4 08:22:17 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:17.892120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a06701-b7c1-4119-ae79-fa2cbae12b83 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:17.997764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a06701-b7c1-4119-ae79-fa2cbae12b83 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:18.036370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468e232-bd7c-41e3-b378-5d7f4b85cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:18.037005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468e232-bd7c-41e3-b378-5d7f4b85cd32 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:18.037284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468e232-bd7c-41e3-b378-5d7f4b85cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:18.037561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468e232-bd7c-41e3-b378-5d7f4b85cd32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:18.044393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468e232-bd7c-41e3-b378-5d7f4b85cd32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:18.045837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468e232-bd7c-41e3-b378-5d7f4b85cd32 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e468e232-bd7c-41e3-b378-5d7f4b85cd32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:22:18.057308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:18.059490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:18.060655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:22:18.060655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:22:18.060655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:22:18.060655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:22:18.060655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:22:18.060655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:22:18.060655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:18.060655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:18.060655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 473/955] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:18.068291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:18.105898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468e232-bd7c-41e3-b378-5d7f4b85cd32 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:18.152420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:18.179240 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:18.185785 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c249eff-b5f5-4d17-934c-64ad5c7a22ea None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:18.221522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d3d17-897b-4eea-b4d7-ebfffeac4188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:18.222326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d3d17-897b-4eea-b4d7-ebfffeac4188 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:18.222772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d3d17-897b-4eea-b4d7-ebfffeac4188 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:18.223370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d3d17-897b-4eea-b4d7-ebfffeac4188 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:18.224145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d3d17-897b-4eea-b4d7-ebfffeac4188 None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:18.224546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d3d17-897b-4eea-b4d7-ebfffeac4188 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:18.226440 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d3d17-897b-4eea-b4d7-ebfffeac4188 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:18.246935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468e232-bd7c-41e3-b378-5d7f4b85cd32 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:18.247710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 483/956] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:22:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:18.287254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d869560-17b2-460f-8c34-1c7dd5649899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:18.288162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d869560-17b2-460f-8c34-1c7dd5649899 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:18.288602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d869560-17b2-460f-8c34-1c7dd5649899 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:18.289092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d869560-17b2-460f-8c34-1c7dd5649899 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:18.289835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d869560-17b2-460f-8c34-1c7dd5649899 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:18.291458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d869560-17b2-460f-8c34-1c7dd5649899 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8d869560-17b2-460f-8c34-1c7dd5649899 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:18.301953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:18.303361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:18.304391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:18.311864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 474/957] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:18.313589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d3d17-897b-4eea-b4d7-ebfffeac4188 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:18.426763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d3d17-897b-4eea-b4d7-ebfffeac4188 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:18.473046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e3d81-a455-4c5e-9b8d-7538b337b22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:18.473671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e3d81-a455-4c5e-9b8d-7538b337b22a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:18.473951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e3d81-a455-4c5e-9b8d-7538b337b22a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:18.474223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e3d81-a455-4c5e-9b8d-7538b337b22a None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:18.475457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e3d81-a455-4c5e-9b8d-7538b337b22a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:18.475457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e3d81-a455-4c5e-9b8d-7538b337b22a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:18.476541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e3d81-a455-4c5e-9b8d-7538b337b22a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:18.482539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 484/958] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Oct 4 08:22:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:18.488816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d869560-17b2-460f-8c34-1c7dd5649899 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:18.594143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:18.598580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d869560-17b2-460f-8c34-1c7dd5649899 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:18.640711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945675b-cc6b-4ed8-9b6e-3d33b73f941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:18.641330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945675b-cc6b-4ed8-9b6e-3d33b73f941e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:18.641608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945675b-cc6b-4ed8-9b6e-3d33b73f941e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:18.641880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945675b-cc6b-4ed8-9b6e-3d33b73f941e None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:18.642520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945675b-cc6b-4ed8-9b6e-3d33b73f941e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:18.642855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945675b-cc6b-4ed8-9b6e-3d33b73f941e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:18.644451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945675b-cc6b-4ed8-9b6e-3d33b73f941e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:18.650102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 475/959] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Oct 4 08:22:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:18.655752 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e3d81-a455-4c5e-9b8d-7538b337b22a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:18.679067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:18.747068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71472008-7e37-4a94-b55e-8a4a7fb5e387 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:18.747502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71472008-7e37-4a94-b55e-8a4a7fb5e387 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:18.747901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71472008-7e37-4a94-b55e-8a4a7fb5e387 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:18.749672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 476/960] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:18.755512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a90c-9e82-4195-bbd8-87466ace3ae5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:18.755867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a90c-9e82-4195-bbd8-87466ace3ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:18.756214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a90c-9e82-4195-bbd8-87466ace3ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:18.763274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e3d81-a455-4c5e-9b8d-7538b337b22a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:18.775463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5c59a90c-9e82-4195-bbd8-87466ace3ae5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:18.776865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5c59a90c-9e82-4195-bbd8-87466ace3ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:18.806992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd768d-dd41-41dd-b37d-ca78c522a48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:18.808160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd768d-dd41-41dd-b37d-ca78c522a48a None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:18.808857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd768d-dd41-41dd-b37d-ca78c522a48a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:18.809336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd768d-dd41-41dd-b37d-ca78c522a48a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:18.810910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd768d-dd41-41dd-b37d-ca78c522a48a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:18.812746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd768d-dd41-41dd-b37d-ca78c522a48a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:18.839825 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 485/961] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:22:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:18.869602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 477/962] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:19.145248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd768d-dd41-41dd-b37d-ca78c522a48a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:19.228513 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:19.258165 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd768d-dd41-41dd-b37d-ca78c522a48a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:19.294619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a60e3-04b7-44b6-87a8-7ca56d199e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:19.295793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a60e3-04b7-44b6-87a8-7ca56d199e82 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:19.296271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a60e3-04b7-44b6-87a8-7ca56d199e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:19.296745 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a60e3-04b7-44b6-87a8-7ca56d199e82 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:19.308836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a60e3-04b7-44b6-87a8-7ca56d199e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0d1a60e3-04b7-44b6-87a8-7ca56d199e82 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:19.314428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:19.315465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:19.316395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:19.319111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 486/963] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Oct 4 08:22:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:19.326652 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59a90c-9e82-4195-bbd8-87466ace3ae5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:19.427674 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:19.441685 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59a90c-9e82-4195-bbd8-87466ace3ae5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:19.480528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac217b1-867f-49ad-a34d-dac3c5a72187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:19.481139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac217b1-867f-49ad-a34d-dac3c5a72187 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:19.481420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac217b1-867f-49ad-a34d-dac3c5a72187 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:19.481695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac217b1-867f-49ad-a34d-dac3c5a72187 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:19.482424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac217b1-867f-49ad-a34d-dac3c5a72187 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:19.482759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac217b1-867f-49ad-a34d-dac3c5a72187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:19.484136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac217b1-867f-49ad-a34d-dac3c5a72187 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:19.493676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 478/964] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Oct 4 08:22:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:19.499668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac217b1-867f-49ad-a34d-dac3c5a72187 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:19.499994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fda2a-effa-42e5-bf79-d88286cb1736 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:19.500278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fda2a-effa-42e5-bf79-d88286cb1736 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:19.500669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fda2a-effa-42e5-bf79-d88286cb1736 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:19.502450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 487/965] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:19.508855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc114663-6cb1-4e02-b384-3bf3a757f897 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:19.509143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc114663-6cb1-4e02-b384-3bf3a757f897 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:19.509870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc114663-6cb1-4e02-b384-3bf3a757f897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:19.535024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fc114663-6cb1-4e02-b384-3bf3a757f897 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:19.537316 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fc114663-6cb1-4e02-b384-3bf3a757f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:19.609388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac217b1-867f-49ad-a34d-dac3c5a72187 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:19.628874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 488/966] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:19.648197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24353ce9-3cde-4b93-922a-b94670cd7454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:19.648831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24353ce9-3cde-4b93-922a-b94670cd7454 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:19.649112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24353ce9-3cde-4b93-922a-b94670cd7454 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:19.649385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24353ce9-3cde-4b93-922a-b94670cd7454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:19.660914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24353ce9-3cde-4b93-922a-b94670cd7454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:19.662386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24353ce9-3cde-4b93-922a-b94670cd7454 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-24353ce9-3cde-4b93-922a-b94670cd7454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:19.677759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:19.678757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:19.679649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:19.679649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:19.679649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:19.679649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 479/967] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:19.684435 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc114663-6cb1-4e02-b384-3bf3a757f897 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:19.755619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:19.790949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc114663-6cb1-4e02-b384-3bf3a757f897 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:19.825465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7dfb0-fb62-4106-bc69-3bbe4028c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:19.826413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7dfb0-fb62-4106-bc69-3bbe4028c515 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:19.826913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7dfb0-fb62-4106-bc69-3bbe4028c515 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:19.827380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7dfb0-fb62-4106-bc69-3bbe4028c515 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:19.828205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7dfb0-fb62-4106-bc69-3bbe4028c515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:19.828703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7dfb0-fb62-4106-bc69-3bbe4028c515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:19.830265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7dfb0-fb62-4106-bc69-3bbe4028c515 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:19.842570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 489/968] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:19.850826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24353ce9-3cde-4b93-922a-b94670cd7454 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:19.855033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:19.908905 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7dfb0-fb62-4106-bc69-3bbe4028c515 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:19.961877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24353ce9-3cde-4b93-922a-b94670cd7454 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:19.997583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4929-e6e8-408f-9725-f5f8c586c726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:19.998650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4929-e6e8-408f-9725-f5f8c586c726 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:19.999166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4929-e6e8-408f-9725-f5f8c586c726 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:19.999645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4929-e6e8-408f-9725-f5f8c586c726 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:20.009130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c4929-e6e8-408f-9725-f5f8c586c726 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:20.011037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c4929-e6e8-408f-9725-f5f8c586c726 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:20.023914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7dfb0-fb62-4106-bc69-3bbe4028c515 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fb5c4929-e6e8-408f-9725-f5f8c586c726 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:22:20.025223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:20.026351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:20.029192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 480/969] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Oct 4 08:22:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:20.033373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4929-e6e8-408f-9725-f5f8c586c726 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:20.065630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:20.076391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf83fd5-7ada-42aa-bf08-53ec33eeb077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:20.077466 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf83fd5-7ada-42aa-bf08-53ec33eeb077 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:20.078709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf83fd5-7ada-42aa-bf08-53ec33eeb077 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:20.078709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf83fd5-7ada-42aa-bf08-53ec33eeb077 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:20.080256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf83fd5-7ada-42aa-bf08-53ec33eeb077 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:20.082352 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf83fd5-7ada-42aa-bf08-53ec33eeb077 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:20.107486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 490/970] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:22:19 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:22:20.118629 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:20.175391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4929-e6e8-408f-9725-f5f8c586c726 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:20.218826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf4bb-cb17-43f9-a5e7-505d74c2de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:20.218826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf4bb-cb17-43f9-a5e7-505d74c2de69 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:20.218826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf4bb-cb17-43f9-a5e7-505d74c2de69 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:20.218826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf4bb-cb17-43f9-a5e7-505d74c2de69 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:20.219668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaf4bb-cb17-43f9-a5e7-505d74c2de69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:20.219935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaf4bb-cb17-43f9-a5e7-505d74c2de69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:20.222156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaf4bb-cb17-43f9-a5e7-505d74c2de69 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:20.250527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 481/971] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Oct 4 08:22:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:20.252705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf83fd5-7ada-42aa-bf08-53ec33eeb077 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:20.371626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf83fd5-7ada-42aa-bf08-53ec33eeb077 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:20.407125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc4513-d718-41a5-afaa-919e06fa643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:20.408077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc4513-d718-41a5-afaa-919e06fa643a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:20.408561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc4513-d718-41a5-afaa-919e06fa643a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:20.409573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc4513-d718-41a5-afaa-919e06fa643a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:20.467826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:20.484655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc4513-d718-41a5-afaa-919e06fa643a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:20.486096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc4513-d718-41a5-afaa-919e06fa643a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:20.590255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 491/972] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:20 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:22:20.595987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf4bb-cb17-43f9-a5e7-505d74c2de69 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:20.703890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf4bb-cb17-43f9-a5e7-505d74c2de69 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:20.704221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad959-8193-4758-befa-7172df30c488 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:20.704470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad959-8193-4758-befa-7172df30c488 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:20.704749 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad959-8193-4758-befa-7172df30c488 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:20.707472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 492/973] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:20.711601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2925ed-655e-4d2c-a6b9-89edab3c21ce None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:20.711885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2925ed-655e-4d2c-a6b9-89edab3c21ce None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:20.712161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2925ed-655e-4d2c-a6b9-89edab3c21ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:20.723860 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:20.731129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9a2925ed-655e-4d2c-a6b9-89edab3c21ce None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:20.732782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9a2925ed-655e-4d2c-a6b9-89edab3c21ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:20.747497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf249970-678d-49ad-8384-89d877d58d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:20.748318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249970-678d-49ad-8384-89d877d58d2a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:20.749075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249970-678d-49ad-8384-89d877d58d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:20.749360 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249970-678d-49ad-8384-89d877d58d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:20.762341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf249970-678d-49ad-8384-89d877d58d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:20.763843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf249970-678d-49ad-8384-89d877d58d2a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-bf249970-678d-49ad-8384-89d877d58d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:20.779119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:20.780443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:20.782552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:20.782552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:20.782552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:20.782552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 482/974] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:20.786835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf249970-678d-49ad-8384-89d877d58d2a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:20.814831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 493/975] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:20.899737 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf249970-678d-49ad-8384-89d877d58d2a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:20.935594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f925f4-2ff4-4bca-b0da-9ee78b32a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:20.936325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f925f4-2ff4-4bca-b0da-9ee78b32a2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:20.936606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f925f4-2ff4-4bca-b0da-9ee78b32a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:20.936885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f925f4-2ff4-4bca-b0da-9ee78b32a2b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:20.937577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f925f4-2ff4-4bca-b0da-9ee78b32a2b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:20.937887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f925f4-2ff4-4bca-b0da-9ee78b32a2b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:20.939292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f925f4-2ff4-4bca-b0da-9ee78b32a2b2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:20.952715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 483/976] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:20.958578 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2925ed-655e-4d2c-a6b9-89edab3c21ce None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:20.977607 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:21.072687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2925ed-655e-4d2c-a6b9-89edab3c21ce None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:21.107842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f925f4-2ff4-4bca-b0da-9ee78b32a2b2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:21.110662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79dd9f-876d-4701-9a96-cc1373ce480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:21.111328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79dd9f-876d-4701-9a96-cc1373ce480b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:21.111605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79dd9f-876d-4701-9a96-cc1373ce480b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:21.111874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79dd9f-876d-4701-9a96-cc1373ce480b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:21.119510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79dd9f-876d-4701-9a96-cc1373ce480b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:21.120958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79dd9f-876d-4701-9a96-cc1373ce480b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-ae79dd9f-876d-4701-9a96-cc1373ce480b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:22:21.133457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:21.135519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:21.137565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:22:21.137565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:22:21.137565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:22:21.137565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:22:21.137565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:22:21.137565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:22:21.137565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:21.137565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:21.137565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 494/977] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:21.141299 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79dd9f-876d-4701-9a96-cc1373ce480b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:21.145304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:21.228920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:21.230100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f925f4-2ff4-4bca-b0da-9ee78b32a2b2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:21.254130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79dd9f-876d-4701-9a96-cc1373ce480b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:21.265470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18074d7-70ca-45b7-bc0c-d339a43c9e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:21.266005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18074d7-70ca-45b7-bc0c-d339a43c9e96 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:21.266281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18074d7-70ca-45b7-bc0c-d339a43c9e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:21.266551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18074d7-70ca-45b7-bc0c-d339a43c9e96 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:21.267224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18074d7-70ca-45b7-bc0c-d339a43c9e96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:21.268675 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18074d7-70ca-45b7-bc0c-d339a43c9e96 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:21.271206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: WARNING keystone.server.flask.common [None req-b18074d7-70ca-45b7-bc0c-d339a43c9e96 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 08:22:21.283387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.sql.core [None req-b18074d7-70ca-45b7-bc0c-d339a43c9e96 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:22:21.283387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 08:22:21.283387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [parameters: {'user_id': '5257ec34d6924c6ba802d3a47bdbc017', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 08:22:21.283387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:22:21.289526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda082f3-cbee-4b36-a531-25313bff3d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:21.290181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda082f3-cbee-4b36-a531-25313bff3d65 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:21.290465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda082f3-cbee-4b36-a531-25313bff3d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:21.290771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda082f3-cbee-4b36-a531-25313bff3d65 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b18074d7-70ca-45b7-bc0c-d339a43c9e96 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Oct 04 08:22:21.290874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:22:21.291825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application yield resource Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise self.value Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application session.commit() Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:22:21.298278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:22:21.299470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:22:21.301328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:22:21.302387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [parameters: {'user_id': '5257ec34d6924c6ba802d3a47bdbc017', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:21.305200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 08:22:21.307305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 08:22:21.311715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 08:22:21.311715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 08:22:21.311715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:22:21.311715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:22:21.311715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 08:22:21.311715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:21.312808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda082f3-cbee-4b36-a531-25313bff3d65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:21.312808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda082f3-cbee-4b36-a531-25313bff3d65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:21.313119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 484/978] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Oct 4 08:22:21 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:21.313271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda082f3-cbee-4b36-a531-25313bff3d65 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:21.313415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4c7d0-e086-44bb-a979-a73ccbcf3c4d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:21.313415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4c7d0-e086-44bb-a979-a73ccbcf3c4d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:21.313415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4c7d0-e086-44bb-a979-a73ccbcf3c4d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:21.313415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 485/979] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:21.313415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4c7d0-e086-44bb-a979-a73ccbcf3c4d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:21.320033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 495/980] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:22:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:21.320033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab6eea-4710-4ffa-b38b-2df2048a9f1d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:21.320033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab6eea-4710-4ffa-b38b-2df2048a9f1d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:21.320033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab6eea-4710-4ffa-b38b-2df2048a9f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:21.335280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-69ab6eea-4710-4ffa-b38b-2df2048a9f1d None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:21.336404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-69ab6eea-4710-4ffa-b38b-2df2048a9f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:21.406294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 496/981] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:21.410350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:21.413066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab6eea-4710-4ffa-b38b-2df2048a9f1d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:21.433139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4c7d0-e086-44bb-a979-a73ccbcf3c4d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:21.484612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48600-d05d-4a11-b402-500c827169ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:21.485455 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48600-d05d-4a11-b402-500c827169ca None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:21.485884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48600-d05d-4a11-b402-500c827169ca None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:21.486309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48600-d05d-4a11-b402-500c827169ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:21.490984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:21.494975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db48600-d05d-4a11-b402-500c827169ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:21.496765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db48600-d05d-4a11-b402-500c827169ca None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2db48600-d05d-4a11-b402-500c827169ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:22:21.509050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:21.510036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:21.511376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:21.511376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:21.511376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:22:21.511376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:22:21.511376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:22:21.511376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:22:21.511376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:22:21.511376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:22:21.511376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:22:21.511376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:21.513642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 486/982] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:22:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:21.523614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48600-d05d-4a11-b402-500c827169ca None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:21.533362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab6eea-4710-4ffa-b38b-2df2048a9f1d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:21.581450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d77903-aec5-41d6-ad81-0fa27f472a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:21.582156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d77903-aec5-41d6-ad81-0fa27f472a93 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:21.582432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d77903-aec5-41d6-ad81-0fa27f472a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:21.583794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d77903-aec5-41d6-ad81-0fa27f472a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:21.584604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d77903-aec5-41d6-ad81-0fa27f472a93 None admin] RBAC: Adding query filter params (role.id=62b08115f7ca4b06851d82da540fc071, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=3a90574a4a3141b1a90f1080c6072b31) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:21.584924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d77903-aec5-41d6-ad81-0fa27f472a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:21.586419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d77903-aec5-41d6-ad81-0fa27f472a93 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:21.598704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 497/983] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:21 2022] GET /identity/v3/role_assignments?user.id=3a90574a4a3141b1a90f1080c6072b31&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=62b08115f7ca4b06851d82da540fc071 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:21.651594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48600-d05d-4a11-b402-500c827169ca None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:21.689129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2b5f6-b6c9-492c-bfcc-f8392731da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:21.689751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2b5f6-b6c9-492c-bfcc-f8392731da32 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:21.690030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2b5f6-b6c9-492c-bfcc-f8392731da32 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:21.690163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d77903-aec5-41d6-ad81-0fa27f472a93 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:21.690437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2b5f6-b6c9-492c-bfcc-f8392731da32 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:21.691258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2b5f6-b6c9-492c-bfcc-f8392731da32 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:21.691564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2b5f6-b6c9-492c-bfcc-f8392731da32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:21.693475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2b5f6-b6c9-492c-bfcc-f8392731da32 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:21.746123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 487/984] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Oct 4 08:22:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:21.807458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d77903-aec5-41d6-ad81-0fa27f472a93 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:21.841347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:21.848211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8559bba-5c28-4775-b0b4-068e8ce4ca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:21.848855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559bba-5c28-4775-b0b4-068e8ce4ca5b None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:21.849133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559bba-5c28-4775-b0b4-068e8ce4ca5b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:21.849403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559bba-5c28-4775-b0b4-068e8ce4ca5b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:21.849995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8559bba-5c28-4775-b0b4-068e8ce4ca5b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:21.851683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8559bba-5c28-4775-b0b4-068e8ce4ca5b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-d8559bba-5c28-4775-b0b4-068e8ce4ca5b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:21.862644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:21.863805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:21.865272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 498/985] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:21.869902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2b5f6-b6c9-492c-bfcc-f8392731da32 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:21.884528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:21.984193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2b5f6-b6c9-492c-bfcc-f8392731da32 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:22.020970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2daef9-f22a-4b3f-9ea1-57b668fddd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:22.021680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2daef9-f22a-4b3f-9ea1-57b668fddd90 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:22.022032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2daef9-f22a-4b3f-9ea1-57b668fddd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:22.022376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2daef9-f22a-4b3f-9ea1-57b668fddd90 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:22.023108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2daef9-f22a-4b3f-9ea1-57b668fddd90 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:22.023487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2daef9-f22a-4b3f-9ea1-57b668fddd90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:22.024929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2daef9-f22a-4b3f-9ea1-57b668fddd90 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:22.030564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 488/986] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Oct 4 08:22:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:22.036511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8559bba-5c28-4775-b0b4-068e8ce4ca5b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:22.149426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8559bba-5c28-4775-b0b4-068e8ce4ca5b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:22.186154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb85bf7-d67e-488d-9832-a8e20ba08449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:22.186783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85bf7-d67e-488d-9832-a8e20ba08449 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:22.187060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85bf7-d67e-488d-9832-a8e20ba08449 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:22.187328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85bf7-d67e-488d-9832-a8e20ba08449 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:22.187950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb85bf7-d67e-488d-9832-a8e20ba08449 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:22.188248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb85bf7-d67e-488d-9832-a8e20ba08449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:22.189599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb85bf7-d67e-488d-9832-a8e20ba08449 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:22.194844 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 499/987] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Oct 4 08:22:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:22.200301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2daef9-f22a-4b3f-9ea1-57b668fddd90 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:22.269957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:22.301285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2daef9-f22a-4b3f-9ea1-57b668fddd90 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:22.334955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db45e97-d71f-4215-a346-496e9792e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:22.335637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db45e97-d71f-4215-a346-496e9792e2be None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:22.335980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db45e97-d71f-4215-a346-496e9792e2be None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:22.336312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db45e97-d71f-4215-a346-496e9792e2be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:22.337068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db45e97-d71f-4215-a346-496e9792e2be None admin] RBAC: Adding query filter params (interface=admin, service_id=d4060ef954fa468796e78ab1df953212, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:22.337441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db45e97-d71f-4215-a346-496e9792e2be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:22.338872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db45e97-d71f-4215-a346-496e9792e2be None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:22.348592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 489/988] 10.222.0.23 () {56 vars in 1249 bytes} [Tue Oct 4 08:22:22 2022] GET /identity/v3/endpoints?service_id=d4060ef954fa468796e78ab1df953212&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:22.349801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb85bf7-d67e-488d-9832-a8e20ba08449 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:22.409317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:22.461516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb85bf7-d67e-488d-9832-a8e20ba08449 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:22.504515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61822bc5-9c1c-457a-9b5a-a3cd0824f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:22.505129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61822bc5-9c1c-457a-9b5a-a3cd0824f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:22.505411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61822bc5-9c1c-457a-9b5a-a3cd0824f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:22.505682 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61822bc5-9c1c-457a-9b5a-a3cd0824f5b2 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:22.506294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61822bc5-9c1c-457a-9b5a-a3cd0824f5b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:22.507695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61822bc5-9c1c-457a-9b5a-a3cd0824f5b2 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:22.518709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 500/989] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Oct 4 08:22:22 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:22:22.535366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bf4ba-71ac-4600-b870-bf1214f3f1c1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:22.535754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bf4ba-71ac-4600-b870-bf1214f3f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:22.536109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bf4ba-71ac-4600-b870-bf1214f3f1c1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:22.537619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 490/990] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:22.543708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7685bb-4f66-47cb-a7ff-8c36ea011b79 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:22.543994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7685bb-4f66-47cb-a7ff-8c36ea011b79 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:22.544266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7685bb-4f66-47cb-a7ff-8c36ea011b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:22.563799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ad7685bb-4f66-47cb-a7ff-8c36ea011b79 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:22.565019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ad7685bb-4f66-47cb-a7ff-8c36ea011b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:22.642724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 501/991] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:22.916623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bf4ba-71ac-4600-b870-bf1214f3f1c1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:23.021519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bf4ba-71ac-4600-b870-bf1214f3f1c1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:23.055652 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d0b70-1666-4f36-9a0b-ce3cec1f2fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:23.056279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0b70-1666-4f36-9a0b-ce3cec1f2fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:23.056557 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0b70-1666-4f36-9a0b-ce3cec1f2fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:23.056828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0b70-1666-4f36-9a0b-ce3cec1f2fe2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:23.057396 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d0b70-1666-4f36-9a0b-ce3cec1f2fe2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:23.058786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d0b70-1666-4f36-9a0b-ce3cec1f2fe2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:23.061338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1e8d0b70-1666-4f36-9a0b-ce3cec1f2fe2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:23.069248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:23.070394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:23.071352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 491/992] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:23.078228 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7685bb-4f66-47cb-a7ff-8c36ea011b79 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:23.132455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:23.180392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7685bb-4f66-47cb-a7ff-8c36ea011b79 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:23.214535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3355e6-f1da-45eb-b3b7-20826fa728f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:23.215168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3355e6-f1da-45eb-b3b7-20826fa728f9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:23.215456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3355e6-f1da-45eb-b3b7-20826fa728f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:23.215727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3355e6-f1da-45eb-b3b7-20826fa728f9 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:23.216347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3355e6-f1da-45eb-b3b7-20826fa728f9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:23.216648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3355e6-f1da-45eb-b3b7-20826fa728f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:23.218014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3355e6-f1da-45eb-b3b7-20826fa728f9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:23.229372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 502/993] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:22:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:23.230427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d0b70-1666-4f36-9a0b-ce3cec1f2fe2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:23.333261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d0b70-1666-4f36-9a0b-ce3cec1f2fe2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:23.366919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402929d-6d5f-4835-9333-63f38ac2e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:23.367528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402929d-6d5f-4835-9333-63f38ac2e98e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:23.367808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402929d-6d5f-4835-9333-63f38ac2e98e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:23.368079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402929d-6d5f-4835-9333-63f38ac2e98e None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:23.368698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402929d-6d5f-4835-9333-63f38ac2e98e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:23.369003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402929d-6d5f-4835-9333-63f38ac2e98e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:23.370361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402929d-6d5f-4835-9333-63f38ac2e98e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:23.380695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 492/994] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:22:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:23.381927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3355e6-f1da-45eb-b3b7-20826fa728f9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:23.490020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3355e6-f1da-45eb-b3b7-20826fa728f9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:23.506828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:23.526288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db554ee-67a3-4808-ae4d-3da5c5c42546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:23.526924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db554ee-67a3-4808-ae4d-3da5c5c42546 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:23.527206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db554ee-67a3-4808-ae4d-3da5c5c42546 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:23.527476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db554ee-67a3-4808-ae4d-3da5c5c42546 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:23.528168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db554ee-67a3-4808-ae4d-3da5c5c42546 None admin] RBAC: Adding query filter params (interface=public, service_id=fb02e53c742a48f29f17365775a8638c, region_id=RegionOne) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:23.528475 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db554ee-67a3-4808-ae4d-3da5c5c42546 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:23.529822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db554ee-67a3-4808-ae4d-3da5c5c42546 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:23.538763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 503/995] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Oct 4 08:22:23 2022] GET /identity/v3/endpoints?service_id=fb02e53c742a48f29f17365775a8638c&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:23.540838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402929d-6d5f-4835-9333-63f38ac2e98e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:23.602468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:23.642036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402929d-6d5f-4835-9333-63f38ac2e98e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:23.676723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227af5b-9b9e-4ff4-8773-b0d40ead7063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:23.677332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227af5b-9b9e-4ff4-8773-b0d40ead7063 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:23.677611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227af5b-9b9e-4ff4-8773-b0d40ead7063 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:23.677883 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227af5b-9b9e-4ff4-8773-b0d40ead7063 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:23.678572 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227af5b-9b9e-4ff4-8773-b0d40ead7063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:23.679976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227af5b-9b9e-4ff4-8773-b0d40ead7063 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:23.694708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 493/996] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Oct 4 08:22:23 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:22:23.944259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035422d-4ab0-4443-bd6b-bd11336d0807 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:23.944619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035422d-4ab0-4443-bd6b-bd11336d0807 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:23.944822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035422d-4ab0-4443-bd6b-bd11336d0807 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:23.946297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 504/997] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:23.951433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4c2be-2caf-4aa1-a546-ca2f5f107f68 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:23.951867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4c2be-2caf-4aa1-a546-ca2f5f107f68 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:23.952033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4c2be-2caf-4aa1-a546-ca2f5f107f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:23.970454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-faf4c2be-2caf-4aa1-a546-ca2f5f107f68 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:23.972556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-faf4c2be-2caf-4aa1-a546-ca2f5f107f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:24.040269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 494/998] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:24.309367 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035422d-4ab0-4443-bd6b-bd11336d0807 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:24.411727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035422d-4ab0-4443-bd6b-bd11336d0807 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:24.446918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8b6c-2fd7-4b1f-bb8d-84a2c76ab9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:24.447542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8b6c-2fd7-4b1f-bb8d-84a2c76ab9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:24.447819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8b6c-2fd7-4b1f-bb8d-84a2c76ab9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:24.448087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8b6c-2fd7-4b1f-bb8d-84a2c76ab9b1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:24.448661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f8b6c-2fd7-4b1f-bb8d-84a2c76ab9b1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:24.450019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f8b6c-2fd7-4b1f-bb8d-84a2c76ab9b1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-037f8b6c-2fd7-4b1f-bb8d-84a2c76ab9b1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:24.462801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:24.463885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:22:24.464753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:24.469246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 505/999] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Oct 4 08:22:24 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:24.470276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4c2be-2caf-4aa1-a546-ca2f5f107f68 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:24.528197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:24.577862 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4c2be-2caf-4aa1-a546-ca2f5f107f68 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:24.615041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516a04b-9453-414a-bfe4-dc4c6801f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:24.615651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516a04b-9453-414a-bfe4-dc4c6801f243 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:24.615931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516a04b-9453-414a-bfe4-dc4c6801f243 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:24.616203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516a04b-9453-414a-bfe4-dc4c6801f243 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:24.616827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516a04b-9453-414a-bfe4-dc4c6801f243 None admin] RBAC: Adding query filter params (name=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:24.617136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516a04b-9453-414a-bfe4-dc4c6801f243 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:24.618508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516a04b-9453-414a-bfe4-dc4c6801f243 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:24.627871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 495/1000] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:24.628987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8b6c-2fd7-4b1f-bb8d-84a2c76ab9b1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:24.676621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:24.676817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018bd24-74d2-47f0-ad2c-6c14833f496d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:24.676921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018bd24-74d2-47f0-ad2c-6c14833f496d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:24.677187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018bd24-74d2-47f0-ad2c-6c14833f496d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:24.682463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 496/1001] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:24.684772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfce86d-b19c-4c2f-88cd-e3e6a3331fc8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:24.685059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfce86d-b19c-4c2f-88cd-e3e6a3331fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:24.685332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfce86d-b19c-4c2f-88cd-e3e6a3331fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:24.703020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0cfce86d-b19c-4c2f-88cd-e3e6a3331fc8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:24.704194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0cfce86d-b19c-4c2f-88cd-e3e6a3331fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:24.740876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8b6c-2fd7-4b1f-bb8d-84a2c76ab9b1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:24.773118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 497/1002] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:24.776209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ba68-1442-4f90-947a-b88a0e4647f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:24.776806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ba68-1442-4f90-947a-b88a0e4647f5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:24.777082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ba68-1442-4f90-947a-b88a0e4647f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:24.777346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ba68-1442-4f90-947a-b88a0e4647f5 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:24.777963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720ba68-1442-4f90-947a-b88a0e4647f5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:24.778260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720ba68-1442-4f90-947a-b88a0e4647f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:24.779626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720ba68-1442-4f90-947a-b88a0e4647f5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:24.795011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 506/1003] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:25.042078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfce86d-b19c-4c2f-88cd-e3e6a3331fc8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:25.094888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:25.145040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfce86d-b19c-4c2f-88cd-e3e6a3331fc8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:25.180062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca81fd-d9d4-421c-89ae-ceef808b4202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:25.180697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca81fd-d9d4-421c-89ae-ceef808b4202 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:25.180977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca81fd-d9d4-421c-89ae-ceef808b4202 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:25.181249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca81fd-d9d4-421c-89ae-ceef808b4202 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:25.181831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca81fd-d9d4-421c-89ae-ceef808b4202 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:25.183724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca81fd-d9d4-421c-89ae-ceef808b4202 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2aca81fd-d9d4-421c-89ae-ceef808b4202 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:25.197603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:25.199270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:25.200182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 498/1004] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Oct 4 08:22:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:25.205263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ba68-1442-4f90-947a-b88a0e4647f5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:25.306910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ba68-1442-4f90-947a-b88a0e4647f5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:25.316942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:25.342013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca7166-fa6a-41d6-b66a-b226278c50e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:25.342699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca7166-fa6a-41d6-b66a-b226278c50e9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:25.342983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca7166-fa6a-41d6-b66a-b226278c50e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:25.343251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca7166-fa6a-41d6-b66a-b226278c50e9 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:25.343873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca7166-fa6a-41d6-b66a-b226278c50e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:25.344175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca7166-fa6a-41d6-b66a-b226278c50e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:25.345602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca7166-fa6a-41d6-b66a-b226278c50e9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:25.355142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 507/1005] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Oct 4 08:22:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:25.356024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca81fd-d9d4-421c-89ae-ceef808b4202 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:25.460760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca81fd-d9d4-421c-89ae-ceef808b4202 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:25.478416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:25.497610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be4c4e-9b1e-4d8b-b87d-ba6679ab81b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:25.498223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be4c4e-9b1e-4d8b-b87d-ba6679ab81b3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:25.498504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be4c4e-9b1e-4d8b-b87d-ba6679ab81b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:25.498803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be4c4e-9b1e-4d8b-b87d-ba6679ab81b3 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:25.499435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be4c4e-9b1e-4d8b-b87d-ba6679ab81b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:25.499743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be4c4e-9b1e-4d8b-b87d-ba6679ab81b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:25.501129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be4c4e-9b1e-4d8b-b87d-ba6679ab81b3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:25.511483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 499/1006] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Oct 4 08:22:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:25.512433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca7166-fa6a-41d6-b66a-b226278c50e9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:25.616015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca7166-fa6a-41d6-b66a-b226278c50e9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:25.650191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb732ed8-3439-4ca7-8593-3fb5681a961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:25.650830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb732ed8-3439-4ca7-8593-3fb5681a961a None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:25.651112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb732ed8-3439-4ca7-8593-3fb5681a961a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:25.651384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb732ed8-3439-4ca7-8593-3fb5681a961a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:25.652057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb732ed8-3439-4ca7-8593-3fb5681a961a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:25.653470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb732ed8-3439-4ca7-8593-3fb5681a961a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:25.678792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 508/1007] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:22:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:22:25.915562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e033a28-115c-4ac3-b242-c49d4786d8b1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:25.915863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e033a28-115c-4ac3-b242-c49d4786d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:25.916034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e033a28-115c-4ac3-b242-c49d4786d8b1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:25.917534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 500/1008] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:25.922517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18d2d-ba02-4205-bd4c-989b838c74e9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:25.922845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18d2d-ba02-4205-bd4c-989b838c74e9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:25.923121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18d2d-ba02-4205-bd4c-989b838c74e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:25.941949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2dc18d2d-ba02-4205-bd4c-989b838c74e9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:25.943135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2dc18d2d-ba02-4205-bd4c-989b838c74e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:25.969382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:26.020271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 509/1009] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:26.297594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e033a28-115c-4ac3-b242-c49d4786d8b1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:26.402021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e033a28-115c-4ac3-b242-c49d4786d8b1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:26.436868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e536f-9811-42cd-bff2-ced06219ae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:26.437496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e536f-9811-42cd-bff2-ced06219ae06 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:26.437776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e536f-9811-42cd-bff2-ced06219ae06 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:26.438045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e536f-9811-42cd-bff2-ced06219ae06 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:26.438619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e536f-9811-42cd-bff2-ced06219ae06 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:26.440104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e536f-9811-42cd-bff2-ced06219ae06 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7c6e536f-9811-42cd-bff2-ced06219ae06 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:26.448962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:26.450177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:26.451236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 501/1010] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:26.456091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18d2d-ba02-4205-bd4c-989b838c74e9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:26.579158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18d2d-ba02-4205-bd4c-989b838c74e9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:26.622063 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a69fae-604d-4879-9c7f-a60112588d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:26.622687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a69fae-604d-4879-9c7f-a60112588d9d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:26.622979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a69fae-604d-4879-9c7f-a60112588d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:26.623256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a69fae-604d-4879-9c7f-a60112588d9d None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:26.623896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a69fae-604d-4879-9c7f-a60112588d9d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:26.624202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a69fae-604d-4879-9c7f-a60112588d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:26.625592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a69fae-604d-4879-9c7f-a60112588d9d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:26.636002 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 510/1011] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:22:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:26.637541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e536f-9811-42cd-bff2-ced06219ae06 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:26.686260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:26.744745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e536f-9811-42cd-bff2-ced06219ae06 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:26.778692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a109ea9-1e0d-45e2-a90c-ac4cf11066ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:26.779322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a109ea9-1e0d-45e2-a90c-ac4cf11066ec None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:26.779609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a109ea9-1e0d-45e2-a90c-ac4cf11066ec None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:26.779878 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a109ea9-1e0d-45e2-a90c-ac4cf11066ec None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:26.780501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a109ea9-1e0d-45e2-a90c-ac4cf11066ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:26.780811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a109ea9-1e0d-45e2-a90c-ac4cf11066ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:26.782176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a109ea9-1e0d-45e2-a90c-ac4cf11066ec None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:26.792579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 502/1012] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Oct 4 08:22:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:26.794365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a69fae-604d-4879-9c7f-a60112588d9d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:26.825947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:26.927371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a69fae-604d-4879-9c7f-a60112588d9d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:26.965078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca1258-5487-4778-afe8-4863daeb6b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:26.965696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca1258-5487-4778-afe8-4863daeb6b7b None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:26.965976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca1258-5487-4778-afe8-4863daeb6b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:26.966243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca1258-5487-4778-afe8-4863daeb6b7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:26.966947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca1258-5487-4778-afe8-4863daeb6b7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:26.968329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca1258-5487-4778-afe8-4863daeb6b7b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:26.968986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4e4bb-77bb-4649-83b1-eb617b324f06 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:26.969278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4e4bb-77bb-4649-83b1-eb617b324f06 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:26.969553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4e4bb-77bb-4649-83b1-eb617b324f06 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:26.975768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 503/1013] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:26.976976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1aca2-9224-4f88-a3d5-4a77de4208ee None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:26.977254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1aca2-9224-4f88-a3d5-4a77de4208ee None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:26.977526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1aca2-9224-4f88-a3d5-4a77de4208ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:26.999491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 511/1014] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:22:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:22:26.999692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a5b1aca2-9224-4f88-a3d5-4a77de4208ee None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:26.999692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a5b1aca2-9224-4f88-a3d5-4a77de4208ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:27.091490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 504/1015] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:26 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:27.375975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca1258-5487-4778-afe8-4863daeb6b7b None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:27.456636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:27.483304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca1258-5487-4778-afe8-4863daeb6b7b None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:27.518774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510d13b-6109-40b2-bce3-911b7b64aecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:27.519387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510d13b-6109-40b2-bce3-911b7b64aecd None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:27.519672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510d13b-6109-40b2-bce3-911b7b64aecd None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:27.519939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510d13b-6109-40b2-bce3-911b7b64aecd None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:27.520599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510d13b-6109-40b2-bce3-911b7b64aecd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:27.521972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510d13b-6109-40b2-bce3-911b7b64aecd None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:27.538138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 512/1016] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:22:27 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:27.941801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a48d-24f3-4adb-8227-4569148723f2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:27.942364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a48d-24f3-4adb-8227-4569148723f2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:27.942364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a48d-24f3-4adb-8227-4569148723f2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:27.943916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 505/1017] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:27.948915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebc9f5-0512-4c76-8444-4172a1daeec0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:27.949306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebc9f5-0512-4c76-8444-4172a1daeec0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:27.949482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebc9f5-0512-4c76-8444-4172a1daeec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:27.967690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c7ebc9f5-0512-4c76-8444-4172a1daeec0 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:27.968868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c7ebc9f5-0512-4c76-8444-4172a1daeec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:28.046603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 513/1018] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:28.321611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4a48d-24f3-4adb-8227-4569148723f2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:28.361405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:28.428401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4a48d-24f3-4adb-8227-4569148723f2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:28.473841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca958f-bea9-44e6-8cba-068dbe620024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:28.474467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca958f-bea9-44e6-8cba-068dbe620024 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:28.474770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca958f-bea9-44e6-8cba-068dbe620024 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:28.475042 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca958f-bea9-44e6-8cba-068dbe620024 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:28.476142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca958f-bea9-44e6-8cba-068dbe620024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:28.477574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca958f-bea9-44e6-8cba-068dbe620024 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:28.479321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 506/1019] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:28.486704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebc9f5-0512-4c76-8444-4172a1daeec0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:28.548642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:28.588919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebc9f5-0512-4c76-8444-4172a1daeec0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:28.621338 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feaffd-1cf6-440d-8ede-aa43e1cb84d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:28.621937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feaffd-1cf6-440d-8ede-aa43e1cb84d6 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:28.622214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feaffd-1cf6-440d-8ede-aa43e1cb84d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:28.622484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feaffd-1cf6-440d-8ede-aa43e1cb84d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:28.623166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feaffd-1cf6-440d-8ede-aa43e1cb84d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:28.624589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feaffd-1cf6-440d-8ede-aa43e1cb84d6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:28.659185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 514/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:22:28 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:29.331947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b6a2-7d90-4835-a673-9220f798b4c1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:29.332585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b6a2-7d90-4835-a673-9220f798b4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:29.332585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b6a2-7d90-4835-a673-9220f798b4c1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:29.333952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 507/1021] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:29.339073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7469a-f732-4d04-9ae7-9f8d051a5768 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:29.339463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7469a-f732-4d04-9ae7-9f8d051a5768 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:29.339644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7469a-f732-4d04-9ae7-9f8d051a5768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:29.358016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f1f7469a-f732-4d04-9ae7-9f8d051a5768 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:29.359245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f1f7469a-f732-4d04-9ae7-9f8d051a5768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:29.424436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 515/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:29.699812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b6a2-7d90-4835-a673-9220f798b4c1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:29.740994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459b0f-da7b-4a11-a87f-5895e311236b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:29.741325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459b0f-da7b-4a11-a87f-5895e311236b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:29.741547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459b0f-da7b-4a11-a87f-5895e311236b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:29.743051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 516/1023] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:29.747957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9de2b-bd43-4941-828c-9e235cb266e3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:29.748248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9de2b-bd43-4941-828c-9e235cb266e3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:29.748528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9de2b-bd43-4941-828c-9e235cb266e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:29.766431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-05a9de2b-bd43-4941-828c-9e235cb266e3 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:29.767660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-05a9de2b-bd43-4941-828c-9e235cb266e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:29.809296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b6a2-7d90-4835-a673-9220f798b4c1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:29.810390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:29.810869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:29.839210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 517/1024] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:29.855766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fae50-df9f-461f-b9e9-101b33482f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:29.856006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fae50-df9f-461f-b9e9-101b33482f4c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:29.856253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fae50-df9f-461f-b9e9-101b33482f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:29.856574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fae50-df9f-461f-b9e9-101b33482f4c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:29.867376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fae50-df9f-461f-b9e9-101b33482f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-262fae50-df9f-461f-b9e9-101b33482f4c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:29.872118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:29.873065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:29.873923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:29.878512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 508/1025] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Oct 4 08:22:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:29.879783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9de2b-bd43-4941-828c-9e235cb266e3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:29.982304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9de2b-bd43-4941-828c-9e235cb266e3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.016970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1533610-3ab4-4d3f-aae6-249cac8ee43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.017567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1533610-3ab4-4d3f-aae6-249cac8ee43f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.018412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1533610-3ab4-4d3f-aae6-249cac8ee43f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.018739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1533610-3ab4-4d3f-aae6-249cac8ee43f None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.019397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1533610-3ab4-4d3f-aae6-249cac8ee43f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:30.019699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1533610-3ab4-4d3f-aae6-249cac8ee43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.021070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1533610-3ab4-4d3f-aae6-249cac8ee43f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:30.034312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 518/1026] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Oct 4 08:22:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:30.035934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fae50-df9f-461f-b9e9-101b33482f4c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:30.119129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1533610-3ab4-4d3f-aae6-249cac8ee43f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:30.143657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fae50-df9f-461f-b9e9-101b33482f4c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.163542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:30.179907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f32d1-14ec-4973-b308-c305f06cd569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.180527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f32d1-14ec-4973-b308-c305f06cd569 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.180810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f32d1-14ec-4973-b308-c305f06cd569 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.181084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f32d1-14ec-4973-b308-c305f06cd569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.192273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f32d1-14ec-4973-b308-c305f06cd569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.193704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f32d1-14ec-4973-b308-c305f06cd569 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-890f32d1-14ec-4973-b308-c305f06cd569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:30.211901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:30.212865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:30.213789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:30.213789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:30.213789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:30.220594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 509/1027] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:30.221341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f32d1-14ec-4973-b308-c305f06cd569 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:30.234356 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1533610-3ab4-4d3f-aae6-249cac8ee43f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.239577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:30.270362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67cce5-7570-4d99-ab81-35126e43663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.271007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67cce5-7570-4d99-ab81-35126e43663a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.271280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67cce5-7570-4d99-ab81-35126e43663a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.271547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67cce5-7570-4d99-ab81-35126e43663a None admin] PATH_INFO: `/v3/services/image` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.272127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67cce5-7570-4d99-ab81-35126e43663a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.273545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67cce5-7570-4d99-ab81-35126e43663a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-1d67cce5-7570-4d99-ab81-35126e43663a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:30.283211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:30.285112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:30.285991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 519/1028] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Oct 4 08:22:30 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:30.290357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67cce5-7570-4d99-ab81-35126e43663a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:30.336214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f32d1-14ec-4973-b308-c305f06cd569 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.372733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305f6f6-2974-4b4b-a880-b3b1e7dd0ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.373338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f6f6-2974-4b4b-a880-b3b1e7dd0ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.373616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f6f6-2974-4b4b-a880-b3b1e7dd0ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.373887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f6f6-2974-4b4b-a880-b3b1e7dd0ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.374527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305f6f6-2974-4b4b-a880-b3b1e7dd0ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:30.374879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305f6f6-2974-4b4b-a880-b3b1e7dd0ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.376226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305f6f6-2974-4b4b-a880-b3b1e7dd0ec7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:30.388679 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 510/1029] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:30.394227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305f6f6-2974-4b4b-a880-b3b1e7dd0ec7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:30.402831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67cce5-7570-4d99-ab81-35126e43663a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.404856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:30.441958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7640965-4869-49e7-a8f6-153fd53e92e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.442565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640965-4869-49e7-a8f6-153fd53e92e3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.442872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640965-4869-49e7-a8f6-153fd53e92e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.443146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640965-4869-49e7-a8f6-153fd53e92e3 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.443780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7640965-4869-49e7-a8f6-153fd53e92e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:30.444081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7640965-4869-49e7-a8f6-153fd53e92e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.445444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7640965-4869-49e7-a8f6-153fd53e92e3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:30.450568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 520/1030] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:30.457284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7640965-4869-49e7-a8f6-153fd53e92e3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:30.490047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:30.515902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305f6f6-2974-4b4b-a880-b3b1e7dd0ec7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.552969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f0af8-1e6a-4b54-8bc2-212408c6d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.553593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f0af8-1e6a-4b54-8bc2-212408c6d9fa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.553874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f0af8-1e6a-4b54-8bc2-212408c6d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.554144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f0af8-1e6a-4b54-8bc2-212408c6d9fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.561540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f0af8-1e6a-4b54-8bc2-212408c6d9fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.563002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f0af8-1e6a-4b54-8bc2-212408c6d9fa None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:30.566271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7640965-4869-49e7-a8f6-153fd53e92e3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7a5f0af8-1e6a-4b54-8bc2-212408c6d9fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:22:30.574769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:30.575773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:30.576802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 511/1031] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Oct 4 08:22:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:30.582235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f0af8-1e6a-4b54-8bc2-212408c6d9fa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:30.605407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69189091-4ae2-4bdd-b77d-0c7ec2a5ec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.606016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189091-4ae2-4bdd-b77d-0c7ec2a5ec1d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.606292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189091-4ae2-4bdd-b77d-0c7ec2a5ec1d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.606562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189091-4ae2-4bdd-b77d-0c7ec2a5ec1d None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.607211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69189091-4ae2-4bdd-b77d-0c7ec2a5ec1d None admin] RBAC: Adding query filter params (type=image) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:30.607513 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69189091-4ae2-4bdd-b77d-0c7ec2a5ec1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.608875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69189091-4ae2-4bdd-b77d-0c7ec2a5ec1d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:30.613960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 521/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:30.619729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69189091-4ae2-4bdd-b77d-0c7ec2a5ec1d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:30.651497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:30.686247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f0af8-1e6a-4b54-8bc2-212408c6d9fa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.722088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67340fc4-44d0-43ac-aec5-dfaa1a6d5535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.722725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340fc4-44d0-43ac-aec5-dfaa1a6d5535 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.723013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340fc4-44d0-43ac-aec5-dfaa1a6d5535 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.723293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340fc4-44d0-43ac-aec5-dfaa1a6d5535 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.724024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67340fc4-44d0-43ac-aec5-dfaa1a6d5535 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:30.724338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67340fc4-44d0-43ac-aec5-dfaa1a6d5535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.726003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67340fc4-44d0-43ac-aec5-dfaa1a6d5535 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:30.728055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:30.730106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69189091-4ae2-4bdd-b77d-0c7ec2a5ec1d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.751308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 512/1033] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Oct 4 08:22:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:30.758048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67340fc4-44d0-43ac-aec5-dfaa1a6d5535 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:30.774814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f1bda-afa2-4dc7-ade0-605314d57dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.775426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f1bda-afa2-4dc7-ade0-605314d57dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.775704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f1bda-afa2-4dc7-ade0-605314d57dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.775976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f1bda-afa2-4dc7-ade0-605314d57dd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.776677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f1bda-afa2-4dc7-ade0-605314d57dd0 None admin] RBAC: Adding query filter params (interface=public, service_id=2215fbf88676424796ffbcbab829ec3d, region_id=RegionOne) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:30.776986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f1bda-afa2-4dc7-ade0-605314d57dd0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.778347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f1bda-afa2-4dc7-ade0-605314d57dd0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:30.784042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 522/1034] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Oct 4 08:22:30 2022] GET /identity/v3/endpoints?service_id=2215fbf88676424796ffbcbab829ec3d&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:30.789602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f1bda-afa2-4dc7-ade0-605314d57dd0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:30.863609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67340fc4-44d0-43ac-aec5-dfaa1a6d5535 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.886072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:30.893395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f1bda-afa2-4dc7-ade0-605314d57dd0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:30.902763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ec514-8c9c-4926-888c-3a7ed2ccb215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.903376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ec514-8c9c-4926-888c-3a7ed2ccb215 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.903656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ec514-8c9c-4926-888c-3a7ed2ccb215 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.903925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ec514-8c9c-4926-888c-3a7ed2ccb215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.928634 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dd24c-e95d-405c-9549-7ad2354f8ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:30.929236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dd24c-e95d-405c-9549-7ad2354f8ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.929511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dd24c-e95d-405c-9549-7ad2354f8ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.929784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dd24c-e95d-405c-9549-7ad2354f8ea1 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.930374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dd24c-e95d-405c-9549-7ad2354f8ea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.931766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dd24c-e95d-405c-9549-7ad2354f8ea1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:30.938203 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 523/1035] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Oct 4 08:22:30 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:22:30.939402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc30788-6bae-4e5d-9902-2762e6a77c4b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.939724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc30788-6bae-4e5d-9902-2762e6a77c4b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.940599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc30788-6bae-4e5d-9902-2762e6a77c4b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.942717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 524/1036] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:30.947135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a02c9-8a9a-4606-b1f2-e9ed2c7532ba None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:30.947409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a02c9-8a9a-4606-b1f2-e9ed2c7532ba None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:30.947683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a02c9-8a9a-4606-b1f2-e9ed2c7532ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:30.967135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ae1a02c9-8a9a-4606-b1f2-e9ed2c7532ba None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:30.968360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ae1a02c9-8a9a-4606-b1f2-e9ed2c7532ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:30.970774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:30.983881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ec514-8c9c-4926-888c-3a7ed2ccb215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:30.985530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ec514-8c9c-4926-888c-3a7ed2ccb215 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:31.040310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 525/1037] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:31.105850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 513/1038] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:22:31.112790 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a02c9-8a9a-4606-b1f2-e9ed2c7532ba None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:31.215554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:31.235039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a02c9-8a9a-4606-b1f2-e9ed2c7532ba None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:31.274918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc7155-7ad8-4090-bdd2-7d37c42549cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:31.275546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc7155-7ad8-4090-bdd2-7d37c42549cc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:31.275820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc7155-7ad8-4090-bdd2-7d37c42549cc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:31.276085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc7155-7ad8-4090-bdd2-7d37c42549cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:31.286660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc7155-7ad8-4090-bdd2-7d37c42549cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:31.288126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc7155-7ad8-4090-bdd2-7d37c42549cc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0acc7155-7ad8-4090-bdd2-7d37c42549cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:31.303488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:31.304454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:31.305352 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:31.305352 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:31.305352 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:31.306006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 526/1039] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:31.310469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ec514-8c9c-4926-888c-3a7ed2ccb215 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:31.322041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc7155-7ad8-4090-bdd2-7d37c42549cc None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:31.401636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:31.412625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ec514-8c9c-4926-888c-3a7ed2ccb215 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:31.428516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc7155-7ad8-4090-bdd2-7d37c42549cc None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:31.450633 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9d15a-b8cf-4145-b130-664798bd117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:31.451687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9d15a-b8cf-4145-b130-664798bd117b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:31.451960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9d15a-b8cf-4145-b130-664798bd117b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:31.452230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9d15a-b8cf-4145-b130-664798bd117b None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:31.452870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9d15a-b8cf-4145-b130-664798bd117b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:31.453177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9d15a-b8cf-4145-b130-664798bd117b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:31.454549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9d15a-b8cf-4145-b130-664798bd117b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:31.470228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 514/1040] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:31.471558 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90cf80-749e-4c50-8383-e017fa8fa1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:31.472319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90cf80-749e-4c50-8383-e017fa8fa1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:31.472589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90cf80-749e-4c50-8383-e017fa8fa1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:31.472854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90cf80-749e-4c50-8383-e017fa8fa1d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:31.473985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90cf80-749e-4c50-8383-e017fa8fa1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:31.476834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90cf80-749e-4c50-8383-e017fa8fa1d1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:31.476961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9d15a-b8cf-4145-b130-664798bd117b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:31.481468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 527/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:31.482268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90cf80-749e-4c50-8383-e017fa8fa1d1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:31.494053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:31.589073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90cf80-749e-4c50-8383-e017fa8fa1d1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:31.590729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9d15a-b8cf-4145-b130-664798bd117b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:31.624366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e2511-28d3-4264-b89c-f0ac8204f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:31.624982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2511-28d3-4264-b89c-f0ac8204f1d3 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:31.625282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2511-28d3-4264-b89c-f0ac8204f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:31.625536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2511-28d3-4264-b89c-f0ac8204f1d3 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:31.626188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e2511-28d3-4264-b89c-f0ac8204f1d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:31.628946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e2511-28d3-4264-b89c-f0ac8204f1d3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:31.631844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51591bd7-da98-4260-99ac-b188a513c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:31.632640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51591bd7-da98-4260-99ac-b188a513c13f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:31.633088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51591bd7-da98-4260-99ac-b188a513c13f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:31.633521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51591bd7-da98-4260-99ac-b188a513c13f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:31.643140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51591bd7-da98-4260-99ac-b188a513c13f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:31.644634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51591bd7-da98-4260-99ac-b188a513c13f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:31.658913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 528/1042] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:22:31 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-51591bd7-da98-4260-99ac-b188a513c13f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:22:31.659363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:31.660833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:31.661954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:22:31.661954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:22:31.661954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:22:31.661954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:22:31.661954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:22:31.661954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:22:31.661954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:31.661954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:31.661954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 515/1043] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:31.672108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e2511-28d3-4264-b89c-f0ac8204f1d3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:31.741584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:31.786576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e2511-28d3-4264-b89c-f0ac8204f1d3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:31.823446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bce26b-196c-4491-99cd-6a91ff871aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:31.824067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bce26b-196c-4491-99cd-6a91ff871aad None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:31.824348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bce26b-196c-4491-99cd-6a91ff871aad None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:31.824620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bce26b-196c-4491-99cd-6a91ff871aad None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:31.825326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bce26b-196c-4491-99cd-6a91ff871aad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:31.825635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bce26b-196c-4491-99cd-6a91ff871aad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:31.827126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bce26b-196c-4491-99cd-6a91ff871aad None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:31.844860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 529/1044] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:31.847783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51591bd7-da98-4260-99ac-b188a513c13f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:31.867371 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:31.963524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51591bd7-da98-4260-99ac-b188a513c13f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:32.000157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18e414-ab0e-4800-9db4-0dfa8c86033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:32.000764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18e414-ab0e-4800-9db4-0dfa8c86033d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:32.001044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18e414-ab0e-4800-9db4-0dfa8c86033d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:32.001314 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18e414-ab0e-4800-9db4-0dfa8c86033d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:32.002030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18e414-ab0e-4800-9db4-0dfa8c86033d None admin] RBAC: Adding query filter params (role.id=62b08115f7ca4b06851d82da540fc071, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=2c6603b106fa4db58f3d1b5099606ffa) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:32.002992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18e414-ab0e-4800-9db4-0dfa8c86033d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:32.004432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18e414-ab0e-4800-9db4-0dfa8c86033d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:32.010188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 516/1045] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:31 2022] GET /identity/v3/role_assignments?user.id=2c6603b106fa4db58f3d1b5099606ffa&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=62b08115f7ca4b06851d82da540fc071 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:33.197594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe72879-f90c-4381-b771-72fa661c3ad2 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:33.198107 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe72879-f90c-4381-b771-72fa661c3ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:33.198222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe72879-f90c-4381-b771-72fa661c3ad2 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:33.199685 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 530/1046] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:33.204684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890a4e-44ec-4d6c-bc9f-2ecd2fe9ca50 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:33.205063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890a4e-44ec-4d6c-bc9f-2ecd2fe9ca50 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:33.205354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890a4e-44ec-4d6c-bc9f-2ecd2fe9ca50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:33.224947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c4890a4e-44ec-4d6c-bc9f-2ecd2fe9ca50 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:33.226244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c4890a4e-44ec-4d6c-bc9f-2ecd2fe9ca50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:33.300610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 517/1047] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:33.575326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe72879-f90c-4381-b771-72fa661c3ad2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:33.684409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe72879-f90c-4381-b771-72fa661c3ad2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:33.709972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:33.722511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4201e-a67a-4f73-a864-96f04438a844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:33.723110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4201e-a67a-4f73-a864-96f04438a844 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:33.723391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4201e-a67a-4f73-a864-96f04438a844 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:33.723660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4201e-a67a-4f73-a864-96f04438a844 None admin] PATH_INFO: `/v3/services/image` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:33.724243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4201e-a67a-4f73-a864-96f04438a844 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:33.725604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4201e-a67a-4f73-a864-96f04438a844 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-0cb4201e-a67a-4f73-a864-96f04438a844 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:33.734322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:33.735477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:22:33.737142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:33.739024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 531/1048] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Oct 4 08:22:33 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:33.742395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890a4e-44ec-4d6c-bc9f-2ecd2fe9ca50 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:33.750496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:33.848196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890a4e-44ec-4d6c-bc9f-2ecd2fe9ca50 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:33.882732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0e9b7-ae0e-491e-9042-b12eb38d3ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:33.883338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e9b7-ae0e-491e-9042-b12eb38d3ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:33.883613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e9b7-ae0e-491e-9042-b12eb38d3ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:33.883881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e9b7-ae0e-491e-9042-b12eb38d3ad3 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:33.884504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0e9b7-ae0e-491e-9042-b12eb38d3ad3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:33.884804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0e9b7-ae0e-491e-9042-b12eb38d3ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:33.886176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0e9b7-ae0e-491e-9042-b12eb38d3ad3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:33.895975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 518/1049] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:33.897527 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4201e-a67a-4f73-a864-96f04438a844 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:33.943368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81dc7ac-c627-4fe5-a366-4d9737368855 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:33.943659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81dc7ac-c627-4fe5-a366-4d9737368855 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:33.943935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81dc7ac-c627-4fe5-a366-4d9737368855 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:33.946711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 519/1050] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:33.950391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b0e2a-a887-44fc-bc9d-0a62af0a9685 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:33.950699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b0e2a-a887-44fc-bc9d-0a62af0a9685 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:33.950986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b0e2a-a887-44fc-bc9d-0a62af0a9685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:33.969041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ba2b0e2a-a887-44fc-bc9d-0a62af0a9685 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:33.970470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ba2b0e2a-a887-44fc-bc9d-0a62af0a9685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:34.010405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4201e-a67a-4f73-a864-96f04438a844 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:34.040129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:34.052218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c25e1d-0be2-4d90-ac7c-7a563e1a44e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:34.052828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c25e1d-0be2-4d90-ac7c-7a563e1a44e5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:34.053103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c25e1d-0be2-4d90-ac7c-7a563e1a44e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:34.053368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c25e1d-0be2-4d90-ac7c-7a563e1a44e5 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:34.053994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c25e1d-0be2-4d90-ac7c-7a563e1a44e5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:34.054290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c25e1d-0be2-4d90-ac7c-7a563e1a44e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:34.055014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 520/1051] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:34.055747 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c25e1d-0be2-4d90-ac7c-7a563e1a44e5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:34.060828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 532/1052] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:34.067340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b0e2a-a887-44fc-bc9d-0a62af0a9685 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:34.147027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f549-d4aa-46fc-83b0-360e52d1d753 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:34.147313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f549-d4aa-46fc-83b0-360e52d1d753 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:34.147631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f549-d4aa-46fc-83b0-360e52d1d753 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:34.149268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 533/1053] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:34.155526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cff3c8-e45a-44f7-bf75-7e1bba5f29dc None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:34.155872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cff3c8-e45a-44f7-bf75-7e1bba5f29dc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:34.156144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cff3c8-e45a-44f7-bf75-7e1bba5f29dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:34.173828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a5cff3c8-e45a-44f7-bf75-7e1bba5f29dc None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:34.175326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a5cff3c8-e45a-44f7-bf75-7e1bba5f29dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:34.176930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b0e2a-a887-44fc-bc9d-0a62af0a9685 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:34.212072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da3527-c11d-4f7d-95df-070c7ff4728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:34.212710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da3527-c11d-4f7d-95df-070c7ff4728c None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:34.212944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da3527-c11d-4f7d-95df-070c7ff4728c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:34.213219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da3527-c11d-4f7d-95df-070c7ff4728c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:34.213893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da3527-c11d-4f7d-95df-070c7ff4728c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:34.215337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da3527-c11d-4f7d-95df-070c7ff4728c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:34.224306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:34.246719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 521/1054] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:22:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:22:34.268857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 534/1055] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:34.313493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da3527-c11d-4f7d-95df-070c7ff4728c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:34.375619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:34.428081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da3527-c11d-4f7d-95df-070c7ff4728c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:34.465853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadcda3-c61f-4644-853a-d5dff36cfe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:34.466487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadcda3-c61f-4644-853a-d5dff36cfe73 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:34.466789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadcda3-c61f-4644-853a-d5dff36cfe73 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:34.467065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadcda3-c61f-4644-853a-d5dff36cfe73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:34.478493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadcda3-c61f-4644-853a-d5dff36cfe73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7aadcda3-c61f-4644-853a-d5dff36cfe73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:34.483271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:34.484202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:34.485065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 522/1056] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:22:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:34.492448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cff3c8-e45a-44f7-bf75-7e1bba5f29dc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:34.537909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadcda3-c61f-4644-853a-d5dff36cfe73 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:34.598420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cff3c8-e45a-44f7-bf75-7e1bba5f29dc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:34.636267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468a51-623a-41fa-9d6e-2af83fbb37ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:34.637190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468a51-623a-41fa-9d6e-2af83fbb37ae None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:34.637474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468a51-623a-41fa-9d6e-2af83fbb37ae None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:34.637743 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468a51-623a-41fa-9d6e-2af83fbb37ae None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:34.638403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d468a51-623a-41fa-9d6e-2af83fbb37ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:34.638766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d468a51-623a-41fa-9d6e-2af83fbb37ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:34.640086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d468a51-623a-41fa-9d6e-2af83fbb37ae None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:34.646844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadcda3-c61f-4644-853a-d5dff36cfe73 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:34.649246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 535/1057] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:22:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:34.654816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468a51-623a-41fa-9d6e-2af83fbb37ae None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:34.665630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:34.685421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739714c-fcea-4ecd-b2e9-8b81119a2d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:34.686048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739714c-fcea-4ecd-b2e9-8b81119a2d27 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:34.686331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739714c-fcea-4ecd-b2e9-8b81119a2d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:34.686606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739714c-fcea-4ecd-b2e9-8b81119a2d27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:34.698224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739714c-fcea-4ecd-b2e9-8b81119a2d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:34.699441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2739714c-fcea-4ecd-b2e9-8b81119a2d27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:34.703250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:34.704304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:34.705832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 523/1058] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Oct 4 08:22:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:34.710884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739714c-fcea-4ecd-b2e9-8b81119a2d27 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:34.770100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468a51-623a-41fa-9d6e-2af83fbb37ae None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:34.810459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8e823-b167-4565-9fac-b1e239586427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:34.811174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e823-b167-4565-9fac-b1e239586427 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:34.811456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e823-b167-4565-9fac-b1e239586427 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:34.811725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e823-b167-4565-9fac-b1e239586427 None admin] PATH_INFO: `/v3/users/c1e6c9c251154c6a8ebfcbccb0120942` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:34.816196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739714c-fcea-4ecd-b2e9-8b81119a2d27 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:34.827351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8e823-b167-4565-9fac-b1e239586427 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e6c9c251154c6a8ebfcbccb0120942)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:34.828781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8e823-b167-4565-9fac-b1e239586427 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:34.831776 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 536/1059] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:22:34 2022] GET /identity/v3/users/c1e6c9c251154c6a8ebfcbccb0120942 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:34.837261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8e823-b167-4565-9fac-b1e239586427 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:34.859509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e27f5-8a2d-4731-a9a7-aaa0a457ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:34.860619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e27f5-8a2d-4731-a9a7-aaa0a457ea18 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:34.861228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e27f5-8a2d-4731-a9a7-aaa0a457ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:34.862057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e27f5-8a2d-4731-a9a7-aaa0a457ea18 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:34.863194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e27f5-8a2d-4731-a9a7-aaa0a457ea18 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:34.863676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e27f5-8a2d-4731-a9a7-aaa0a457ea18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:34.865890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e27f5-8a2d-4731-a9a7-aaa0a457ea18 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:34.875798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 524/1060] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Oct 4 08:22:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:34.882502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e27f5-8a2d-4731-a9a7-aaa0a457ea18 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:34.923261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:34.938128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:34.943185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8e823-b167-4565-9fac-b1e239586427 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:34.983360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f011f3a-e639-4f4c-9c6b-22e1f528e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:34.983981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f011f3a-e639-4f4c-9c6b-22e1f528e10d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:34.984264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f011f3a-e639-4f4c-9c6b-22e1f528e10d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:34.984539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f011f3a-e639-4f4c-9c6b-22e1f528e10d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:34.999816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e27f5-8a2d-4731-a9a7-aaa0a457ea18 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:35.036450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4f3e5-f8fe-4310-915b-92cbefc9f7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:35.037299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4f3e5-f8fe-4310-915b-92cbefc9f7bb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:35.037454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4f3e5-f8fe-4310-915b-92cbefc9f7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:35.037642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4f3e5-f8fe-4310-915b-92cbefc9f7bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:35.048196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4f3e5-f8fe-4310-915b-92cbefc9f7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:35.049658 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4f3e5-f8fe-4310-915b-92cbefc9f7bb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:35.058050 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f011f3a-e639-4f4c-9c6b-22e1f528e10d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:35.059511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f011f3a-e639-4f4c-9c6b-22e1f528e10d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-67c4f3e5-f8fe-4310-915b-92cbefc9f7bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:35.064381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:35.065421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:35.071133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:35.071133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:35.071133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:35.071133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 525/1061] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:35.071133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4f3e5-f8fe-4310-915b-92cbefc9f7bb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:35.169415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:35.175995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:35.179659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 537/1062] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:22:35.180494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f011f3a-e639-4f4c-9c6b-22e1f528e10d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:35.186928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4f3e5-f8fe-4310-915b-92cbefc9f7bb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:35.223353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5f904-b120-4c91-be25-131e376c2b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:35.224032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f904-b120-4c91-be25-131e376c2b4d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:35.224288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f904-b120-4c91-be25-131e376c2b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:35.224814 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f904-b120-4c91-be25-131e376c2b4d None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:35.225146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5f904-b120-4c91-be25-131e376c2b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:35.225450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5f904-b120-4c91-be25-131e376c2b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:35.226854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5f904-b120-4c91-be25-131e376c2b4d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:35.244588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 526/1063] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:35.245672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5f904-b120-4c91-be25-131e376c2b4d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:35.301262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f011f3a-e639-4f4c-9c6b-22e1f528e10d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:35.339572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924fa44-be24-42b9-88bd-70df015b9935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:35.340119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fa44-be24-42b9-88bd-70df015b9935 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:35.340397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fa44-be24-42b9-88bd-70df015b9935 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:35.340670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fa44-be24-42b9-88bd-70df015b9935 None admin] PATH_INFO: `/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:35.341789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924fa44-be24-42b9-88bd-70df015b9935 None admin] RBAC: Authorizing `identity:get_project(project_id=38a7d280fba142cca7bf4c9c4e99cd4a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:35.343272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924fa44-be24-42b9-88bd-70df015b9935 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:35.350772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 538/1064] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:22:35 2022] GET /identity/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:35.351619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924fa44-be24-42b9-88bd-70df015b9935 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:35.360701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5f904-b120-4c91-be25-131e376c2b4d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:35.403923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c650709-2727-49e9-a3c3-506a896cd2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:35.404632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c650709-2727-49e9-a3c3-506a896cd2bd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:35.405433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c650709-2727-49e9-a3c3-506a896cd2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:35.405733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c650709-2727-49e9-a3c3-506a896cd2bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:35.416488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c650709-2727-49e9-a3c3-506a896cd2bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:35.417957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c650709-2727-49e9-a3c3-506a896cd2bd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:35.424037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3c650709-2727-49e9-a3c3-506a896cd2bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:22:35.432613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:35.433802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:35.434879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 527/1065] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Oct 4 08:22:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:35.441224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c650709-2727-49e9-a3c3-506a896cd2bd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:35.454950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:35.476574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924fa44-be24-42b9-88bd-70df015b9935 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:35.519621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1ee48-85c8-4dee-9efd-f78e13f8e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:35.520244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1ee48-85c8-4dee-9efd-f78e13f8e735 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:35.520525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1ee48-85c8-4dee-9efd-f78e13f8e735 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:35.520804 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1ee48-85c8-4dee-9efd-f78e13f8e735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:35.521541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1ee48-85c8-4dee-9efd-f78e13f8e735 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=38a7d280fba142cca7bf4c9c4e99cd4a, user.id=c1e6c9c251154c6a8ebfcbccb0120942) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:35.522113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1ee48-85c8-4dee-9efd-f78e13f8e735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:35.525103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1ee48-85c8-4dee-9efd-f78e13f8e735 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:35.539172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 539/1066] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:35 2022] GET /identity/v3/role_assignments?user.id=c1e6c9c251154c6a8ebfcbccb0120942&scope.project.id=38a7d280fba142cca7bf4c9c4e99cd4a&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:35.566646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c650709-2727-49e9-a3c3-506a896cd2bd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:35.609436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef239a43-09c8-49ad-aaa3-454b8fed2074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:35.609982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef239a43-09c8-49ad-aaa3-454b8fed2074 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:35.610264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef239a43-09c8-49ad-aaa3-454b8fed2074 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:35.610538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef239a43-09c8-49ad-aaa3-454b8fed2074 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:35.611371 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef239a43-09c8-49ad-aaa3-454b8fed2074 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:35.612259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef239a43-09c8-49ad-aaa3-454b8fed2074 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:35.613761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef239a43-09c8-49ad-aaa3-454b8fed2074 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:35.636474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 528/1067] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Oct 4 08:22:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:35.642301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1ee48-85c8-4dee-9efd-f78e13f8e735 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:35.764780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1ee48-85c8-4dee-9efd-f78e13f8e735 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:35.794790 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:35.803731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eabc2d-ed9c-4394-aaf9-ea850a4183fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:35.804384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eabc2d-ed9c-4394-aaf9-ea850a4183fb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:35.804858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eabc2d-ed9c-4394-aaf9-ea850a4183fb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:35.805351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eabc2d-ed9c-4394-aaf9-ea850a4183fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:35.820303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eabc2d-ed9c-4394-aaf9-ea850a4183fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:35.821766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eabc2d-ed9c-4394-aaf9-ea850a4183fb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-88eabc2d-ed9c-4394-aaf9-ea850a4183fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:35.837492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:35.838576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:35.839922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:35.839922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:35.839922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:35.839922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 540/1068] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:35.844813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef239a43-09c8-49ad-aaa3-454b8fed2074 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:35.933882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:35.975212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef239a43-09c8-49ad-aaa3-454b8fed2074 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:36.014579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374f1a8-1ace-43a9-9a7c-e5278015976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:36.016101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374f1a8-1ace-43a9-9a7c-e5278015976e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:36.016101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374f1a8-1ace-43a9-9a7c-e5278015976e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:36.016101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374f1a8-1ace-43a9-9a7c-e5278015976e None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:36.016487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374f1a8-1ace-43a9-9a7c-e5278015976e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:36.016695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374f1a8-1ace-43a9-9a7c-e5278015976e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:36.018702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374f1a8-1ace-43a9-9a7c-e5278015976e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:36.037199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 529/1069] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:36.038549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eabc2d-ed9c-4394-aaf9-ea850a4183fb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:36.164884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eabc2d-ed9c-4394-aaf9-ea850a4183fb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:36.205752 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f75d2-277c-4558-8325-3994e7734712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:36.206541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f75d2-277c-4558-8325-3994e7734712 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:36.207070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f75d2-277c-4558-8325-3994e7734712 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:36.207581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f75d2-277c-4558-8325-3994e7734712 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:36.214656 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f75d2-277c-4558-8325-3994e7734712 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:36.216128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f75d2-277c-4558-8325-3994e7734712 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-948f75d2-277c-4558-8325-3994e7734712 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:22:36.228433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:36.229387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:36.230292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:22:36.230292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:22:36.230292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:22:36.230292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:22:36.230292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:22:36.230292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:22:36.230292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:36.230292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:36.234350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 541/1070] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:36.235390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374f1a8-1ace-43a9-9a7c-e5278015976e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:36.338501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374f1a8-1ace-43a9-9a7c-e5278015976e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:36.364663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:36.373428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff07f0-1ffb-46f4-b596-dc70864d30cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:36.374042 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff07f0-1ffb-46f4-b596-dc70864d30cc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:36.374319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff07f0-1ffb-46f4-b596-dc70864d30cc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:36.374588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff07f0-1ffb-46f4-b596-dc70864d30cc None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:36.375301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff07f0-1ffb-46f4-b596-dc70864d30cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:36.375604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff07f0-1ffb-46f4-b596-dc70864d30cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:36.377614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff07f0-1ffb-46f4-b596-dc70864d30cc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:36.389799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 530/1071] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:22:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:36.395569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f75d2-277c-4558-8325-3994e7734712 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:36.441799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:36.509730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f75d2-277c-4558-8325-3994e7734712 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:36.543273 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d564f-93ad-430d-ae9c-d5283049ea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:36.543922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d564f-93ad-430d-ae9c-d5283049ea46 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:36.544198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d564f-93ad-430d-ae9c-d5283049ea46 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:36.544465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d564f-93ad-430d-ae9c-d5283049ea46 None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/2c6603b106fa4db58f3d1b5099606ffa/roles/62b08115f7ca4b06851d82da540fc071` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:36.546553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d564f-93ad-430d-ae9c-d5283049ea46 None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=2c6603b106fa4db58f3d1b5099606ffa, role_id=62b08115f7ca4b06851d82da540fc071)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:36.547997 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d564f-93ad-430d-ae9c-d5283049ea46 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:36.559130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c4e13-6a47-49e3-918e-61ddc46aaac9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:36.559427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c4e13-6a47-49e3-918e-61ddc46aaac9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:36.559723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c4e13-6a47-49e3-918e-61ddc46aaac9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:36.561200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 531/1072] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:36.562657 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 542/1073] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:22:36 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/2c6603b106fa4db58f3d1b5099606ffa/roles/62b08115f7ca4b06851d82da540fc071 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:22:36.568287 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c036f3-7318-4370-a006-5eb47af3f8e9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:36.568585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c036f3-7318-4370-a006-5eb47af3f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:36.568851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c036f3-7318-4370-a006-5eb47af3f8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:36.588568 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-09c036f3-7318-4370-a006-5eb47af3f8e9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:36.589818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-09c036f3-7318-4370-a006-5eb47af3f8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:36.664241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 532/1074] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:36.935328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d564f-93ad-430d-ae9c-d5283049ea46 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:37.036315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d564f-93ad-430d-ae9c-d5283049ea46 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:37.038182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:37.072723 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2ae92-9fb9-4e93-9d52-2e2a65c9f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:37.073310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ae92-9fb9-4e93-9d52-2e2a65c9f777 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:37.073582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ae92-9fb9-4e93-9d52-2e2a65c9f777 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:37.073850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ae92-9fb9-4e93-9d52-2e2a65c9f777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:37.143665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2ae92-9fb9-4e93-9d52-2e2a65c9f777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:37.145493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2ae92-9fb9-4e93-9d52-2e2a65c9f777 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:37.247602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 543/1075] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:22:37.253686 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c036f3-7318-4370-a006-5eb47af3f8e9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:37.358053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c036f3-7318-4370-a006-5eb47af3f8e9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:37.376408 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:37.394870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9da68-d175-46f0-b62f-52eaf9a8f34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:37.395503 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9da68-d175-46f0-b62f-52eaf9a8f34d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:37.395836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9da68-d175-46f0-b62f-52eaf9a8f34d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:37.396111 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9da68-d175-46f0-b62f-52eaf9a8f34d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:37.406736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9da68-d175-46f0-b62f-52eaf9a8f34d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:37.408343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9da68-d175-46f0-b62f-52eaf9a8f34d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3da9da68-d175-46f0-b62f-52eaf9a8f34d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:37.423045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:37.424590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:37.425762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:37.425762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:37.425762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:37.425762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 533/1076] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:37.432663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2ae92-9fb9-4e93-9d52-2e2a65c9f777 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:37.434998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:37.543628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2ae92-9fb9-4e93-9d52-2e2a65c9f777 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:37.576349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4814b2-db5c-4ece-8c57-9bbc023208b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:37.576950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4814b2-db5c-4ece-8c57-9bbc023208b4 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:37.577226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4814b2-db5c-4ece-8c57-9bbc023208b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:37.577493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4814b2-db5c-4ece-8c57-9bbc023208b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:37.578126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4814b2-db5c-4ece-8c57-9bbc023208b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:37.578429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4814b2-db5c-4ece-8c57-9bbc023208b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:37.579811 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4814b2-db5c-4ece-8c57-9bbc023208b4 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:37.594716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 544/1077] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:37.777899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713673f-8fd7-4b40-beda-c7330d0e5ed5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:37.778183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713673f-8fd7-4b40-beda-c7330d0e5ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:37.778464 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713673f-8fd7-4b40-beda-c7330d0e5ed5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:37.779957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 534/1078] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:37.786090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1079939-bbce-46c9-948f-bafd6d2e5721 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:37.786376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1079939-bbce-46c9-948f-bafd6d2e5721 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:37.786650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1079939-bbce-46c9-948f-bafd6d2e5721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:37.806288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b1079939-bbce-46c9-948f-bafd6d2e5721 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:37.807443 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b1079939-bbce-46c9-948f-bafd6d2e5721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:37.867397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:37.879289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 545/1079] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:38.153692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713673f-8fd7-4b40-beda-c7330d0e5ed5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:38.255452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713673f-8fd7-4b40-beda-c7330d0e5ed5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:38.290263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c1b48-d6ad-418d-97cb-38bc4d2fb6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:38.290914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1b48-d6ad-418d-97cb-38bc4d2fb6dd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:38.291196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1b48-d6ad-418d-97cb-38bc4d2fb6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:38.291467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1b48-d6ad-418d-97cb-38bc4d2fb6dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:38.302174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c1b48-d6ad-418d-97cb-38bc4d2fb6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5b2c1b48-d6ad-418d-97cb-38bc4d2fb6dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:38.306955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:38.308070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:38.309016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 535/1080] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:22:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:38.314192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1079939-bbce-46c9-948f-bafd6d2e5721 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:38.411023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1079939-bbce-46c9-948f-bafd6d2e5721 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:38.444315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeec48-f6ba-4024-9e4e-bd05f228068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:38.444909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeec48-f6ba-4024-9e4e-bd05f228068c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:38.445179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeec48-f6ba-4024-9e4e-bd05f228068c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:38.445450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeec48-f6ba-4024-9e4e-bd05f228068c None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:38.446106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeec48-f6ba-4024-9e4e-bd05f228068c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:38.446411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeec48-f6ba-4024-9e4e-bd05f228068c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:38.447801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeec48-f6ba-4024-9e4e-bd05f228068c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:38.457468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 546/1081] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:22:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:38.463375 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c1b48-d6ad-418d-97cb-38bc4d2fb6dd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:38.494416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:38.561676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c1b48-d6ad-418d-97cb-38bc4d2fb6dd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:38.593601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343b6de-87cc-4100-9247-5d0bd1f830b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:38.594217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b6de-87cc-4100-9247-5d0bd1f830b4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:38.594495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b6de-87cc-4100-9247-5d0bd1f830b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:38.594793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b6de-87cc-4100-9247-5d0bd1f830b4 None admin] PATH_INFO: `/v3/users/c1e6c9c251154c6a8ebfcbccb0120942` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:38.596407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343b6de-87cc-4100-9247-5d0bd1f830b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e6c9c251154c6a8ebfcbccb0120942)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:38.597827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343b6de-87cc-4100-9247-5d0bd1f830b4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:38.599412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 536/1082] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:22:38 2022] GET /identity/v3/users/c1e6c9c251154c6a8ebfcbccb0120942 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:38.605328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeec48-f6ba-4024-9e4e-bd05f228068c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:38.664694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:38.710193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeec48-f6ba-4024-9e4e-bd05f228068c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:38.739065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3ee6-fcb0-47fd-92b2-45d4b3af6fd8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:38.739349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3ee6-fcb0-47fd-92b2-45d4b3af6fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:38.739643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3ee6-fcb0-47fd-92b2-45d4b3af6fd8 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:38.740951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 537/1083] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:38.744564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80646dd8-95fc-4c8d-ac85-5bf73e0f76dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:38.745195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80646dd8-95fc-4c8d-ac85-5bf73e0f76dc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:38.745474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80646dd8-95fc-4c8d-ac85-5bf73e0f76dc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:38.745744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80646dd8-95fc-4c8d-ac85-5bf73e0f76dc None admin] PATH_INFO: `/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:38.745845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805770-ffbf-4c23-8c8e-967224f78ead None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:38.746028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805770-ffbf-4c23-8c8e-967224f78ead None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:38.746303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805770-ffbf-4c23-8c8e-967224f78ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:38.746880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80646dd8-95fc-4c8d-ac85-5bf73e0f76dc None admin] RBAC: Authorizing `identity:get_project(project_id=38a7d280fba142cca7bf4c9c4e99cd4a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:38.748298 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80646dd8-95fc-4c8d-ac85-5bf73e0f76dc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:38.750025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 547/1084] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:22:38 2022] GET /identity/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:38.756132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80646dd8-95fc-4c8d-ac85-5bf73e0f76dc None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:38.766460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e7805770-ffbf-4c23-8c8e-967224f78ead None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:38.768237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e7805770-ffbf-4c23-8c8e-967224f78ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:38.833825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 538/1085] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:38.854787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80646dd8-95fc-4c8d-ac85-5bf73e0f76dc None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:38.876427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:38.889283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03330efc-346b-4312-9ef9-433be089ac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:38.889935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330efc-346b-4312-9ef9-433be089ac5f None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:38.890218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330efc-346b-4312-9ef9-433be089ac5f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:38.890488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330efc-346b-4312-9ef9-433be089ac5f None admin] PATH_INFO: `/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a/users/c1e6c9c251154c6a8ebfcbccb0120942/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:38.892447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03330efc-346b-4312-9ef9-433be089ac5f None admin] RBAC: Authorizing `identity:create_grant(project_id=38a7d280fba142cca7bf4c9c4e99cd4a, user_id=c1e6c9c251154c6a8ebfcbccb0120942, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:38.893948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03330efc-346b-4312-9ef9-433be089ac5f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:38.906189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 548/1086] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:22:38 2022] PUT /identity/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a/users/c1e6c9c251154c6a8ebfcbccb0120942/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:22:39.103589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7805770-ffbf-4c23-8c8e-967224f78ead None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:39.131447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:39.202650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7805770-ffbf-4c23-8c8e-967224f78ead None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:39.236696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec358cc2-69df-4eda-b04e-460fb77bc569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:39.237333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358cc2-69df-4eda-b04e-460fb77bc569 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:39.237613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358cc2-69df-4eda-b04e-460fb77bc569 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:39.237881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358cc2-69df-4eda-b04e-460fb77bc569 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:39.247804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec358cc2-69df-4eda-b04e-460fb77bc569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ec358cc2-69df-4eda-b04e-460fb77bc569 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:39.252611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:39.253699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:39.254562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 539/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Oct 4 08:22:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:39.259651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03330efc-346b-4312-9ef9-433be089ac5f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:39.357246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03330efc-346b-4312-9ef9-433be089ac5f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:39.390012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529e038-5957-407f-9d00-8e1f907398ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:39.390603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529e038-5957-407f-9d00-8e1f907398ef None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:39.390906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529e038-5957-407f-9d00-8e1f907398ef None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:39.391172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529e038-5957-407f-9d00-8e1f907398ef None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:39.391822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529e038-5957-407f-9d00-8e1f907398ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:39.392118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529e038-5957-407f-9d00-8e1f907398ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:39.393464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529e038-5957-407f-9d00-8e1f907398ef None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:39.401179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 549/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Oct 4 08:22:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:39.407291 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec358cc2-69df-4eda-b04e-460fb77bc569 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:39.498660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:39.511089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec358cc2-69df-4eda-b04e-460fb77bc569 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:39.544952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f186e-f252-40a6-9a23-4ea360b33646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:39.545572 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f186e-f252-40a6-9a23-4ea360b33646 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:39.545849 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f186e-f252-40a6-9a23-4ea360b33646 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:39.546119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f186e-f252-40a6-9a23-4ea360b33646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:39.557424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f186e-f252-40a6-9a23-4ea360b33646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:39.558893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f186e-f252-40a6-9a23-4ea360b33646 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cd4f186e-f252-40a6-9a23-4ea360b33646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:39.572793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:39.573942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:39.575415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:39.575415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:39.575415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:39.575415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 540/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:39.579669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529e038-5957-407f-9d00-8e1f907398ef None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:39.624913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:39.678609 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529e038-5957-407f-9d00-8e1f907398ef None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:39.710850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d244360-07f6-4567-9a60-7eda95b3c238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:39.711457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d244360-07f6-4567-9a60-7eda95b3c238 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:39.711741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d244360-07f6-4567-9a60-7eda95b3c238 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:39.712017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d244360-07f6-4567-9a60-7eda95b3c238 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:39.712661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d244360-07f6-4567-9a60-7eda95b3c238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:39.712969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d244360-07f6-4567-9a60-7eda95b3c238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:39.714326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d244360-07f6-4567-9a60-7eda95b3c238 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:39.726292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 550/1090] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:39.731972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f186e-f252-40a6-9a23-4ea360b33646 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:39.831676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f186e-f252-40a6-9a23-4ea360b33646 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:39.863803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d63c2-2dfd-40e3-b6e0-437f562c71b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:39.864420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d63c2-2dfd-40e3-b6e0-437f562c71b8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:39.864701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d63c2-2dfd-40e3-b6e0-437f562c71b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:39.864972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d63c2-2dfd-40e3-b6e0-437f562c71b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:39.872082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d63c2-2dfd-40e3-b6e0-437f562c71b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:39.873530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d63c2-2dfd-40e3-b6e0-437f562c71b8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:39.876060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-199d63c2-2dfd-40e3-b6e0-437f562c71b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:22:39.885484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:39.886668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:39.887753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 541/1091] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Oct 4 08:22:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:39.892964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d244360-07f6-4567-9a60-7eda95b3c238 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:39.989727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d244360-07f6-4567-9a60-7eda95b3c238 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:39.992034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:40.025392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e229c2f-579e-4b21-ab7f-b85f1a593090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:40.025990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e229c2f-579e-4b21-ab7f-b85f1a593090 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:40.026265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e229c2f-579e-4b21-ab7f-b85f1a593090 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:40.026535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e229c2f-579e-4b21-ab7f-b85f1a593090 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:40.027296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e229c2f-579e-4b21-ab7f-b85f1a593090 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:40.027601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e229c2f-579e-4b21-ab7f-b85f1a593090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:40.029013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e229c2f-579e-4b21-ab7f-b85f1a593090 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:40.045648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 551/1092] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Oct 4 08:22:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:40.051921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d63c2-2dfd-40e3-b6e0-437f562c71b8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:40.150272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d63c2-2dfd-40e3-b6e0-437f562c71b8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:40.182215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711928e-a08c-43ac-ad30-abd60f19d1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:40.182853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711928e-a08c-43ac-ad30-abd60f19d1fc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:40.183135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711928e-a08c-43ac-ad30-abd60f19d1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:40.183406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711928e-a08c-43ac-ad30-abd60f19d1fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:40.245405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:40.247829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711928e-a08c-43ac-ad30-abd60f19d1fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:40.249846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711928e-a08c-43ac-ad30-abd60f19d1fc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:40.354081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 542/1093] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:22:40.359856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e229c2f-579e-4b21-ab7f-b85f1a593090 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:40.454892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e229c2f-579e-4b21-ab7f-b85f1a593090 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:40.490296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7c20-3c9f-4e96-aac1-0d79beed6b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:40.490953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7c20-3c9f-4e96-aac1-0d79beed6b7a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:40.491234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7c20-3c9f-4e96-aac1-0d79beed6b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:40.491504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7c20-3c9f-4e96-aac1-0d79beed6b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:40.501198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c7c20-3c9f-4e96-aac1-0d79beed6b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:40.503740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c7c20-3c9f-4e96-aac1-0d79beed6b7a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-e34c7c20-3c9f-4e96-aac1-0d79beed6b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:22:40.518654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:40.519620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:22:40.520995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:22:40.520995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:22:40.520995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:40.520995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 552/1094] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:22:40.525512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711928e-a08c-43ac-ad30-abd60f19d1fc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:40.623130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:40.626181 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711928e-a08c-43ac-ad30-abd60f19d1fc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:40.667524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507019e6-0928-4496-a506-5944c32654ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:40.668134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507019e6-0928-4496-a506-5944c32654ec None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:40.668417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507019e6-0928-4496-a506-5944c32654ec None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:40.668686 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507019e6-0928-4496-a506-5944c32654ec None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:40.669325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507019e6-0928-4496-a506-5944c32654ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:40.669631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507019e6-0928-4496-a506-5944c32654ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:40.671033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507019e6-0928-4496-a506-5944c32654ec None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:40.683212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 543/1095] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:40.688871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7c20-3c9f-4e96-aac1-0d79beed6b7a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:40.705263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:40.786529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7c20-3c9f-4e96-aac1-0d79beed6b7a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:40.819084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466947-96ba-4caa-b6d7-3f30925c8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:40.819704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466947-96ba-4caa-b6d7-3f30925c8773 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:40.819983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466947-96ba-4caa-b6d7-3f30925c8773 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:40.820249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466947-96ba-4caa-b6d7-3f30925c8773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:40.826561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e466947-96ba-4caa-b6d7-3f30925c8773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:40.828016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e466947-96ba-4caa-b6d7-3f30925c8773 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-8e466947-96ba-4caa-b6d7-3f30925c8773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:22:40.838992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:40.839959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:40.841253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:22:40.841253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:22:40.841253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:22:40.841253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:22:40.841253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:22:40.841253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:22:40.841253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:22:40.841253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:22:40.841253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 553/1096] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:22:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:40.846649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507019e6-0928-4496-a506-5944c32654ec None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:40.949048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507019e6-0928-4496-a506-5944c32654ec None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:40.983060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4bc0f-2c7d-4c97-b535-d085e97dd6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:40.983600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4bc0f-2c7d-4c97-b535-d085e97dd6ed None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:40.983883 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4bc0f-2c7d-4c97-b535-d085e97dd6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:40.984156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4bc0f-2c7d-4c97-b535-d085e97dd6ed None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:40.984855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4bc0f-2c7d-4c97-b535-d085e97dd6ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:40.985162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4bc0f-2c7d-4c97-b535-d085e97dd6ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:40.987209 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4bc0f-2c7d-4c97-b535-d085e97dd6ed None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:41.003720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 544/1097] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:22:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:41.010633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466947-96ba-4caa-b6d7-3f30925c8773 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:41.038607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978c79-a5b0-4224-86e3-6d67af7f86d6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:41.038994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978c79-a5b0-4224-86e3-6d67af7f86d6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:41.039269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978c79-a5b0-4224-86e3-6d67af7f86d6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:41.040610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 545/1098] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:22:41.045392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e6644-ab35-4d88-a7e4-c7f9f3778c10 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:41.045672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e6644-ab35-4d88-a7e4-c7f9f3778c10 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:41.045945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e6644-ab35-4d88-a7e4-c7f9f3778c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:41.064774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d98e6644-ab35-4d88-a7e4-c7f9f3778c10 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:41.065967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d98e6644-ab35-4d88-a7e4-c7f9f3778c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:41.080243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:41.090911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:41.116515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466947-96ba-4caa-b6d7-3f30925c8773 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:41.134887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 546/1099] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:41.149220 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a108fe-e551-4c34-a6c3-9bac5266e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:41.149815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a108fe-e551-4c34-a6c3-9bac5266e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:41.150091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a108fe-e551-4c34-a6c3-9bac5266e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:41.150357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a108fe-e551-4c34-a6c3-9bac5266e6e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:41.151100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a108fe-e551-4c34-a6c3-9bac5266e6e1 None admin] RBAC: Adding query filter params (role.id=62b08115f7ca4b06851d82da540fc071, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=2c6603b106fa4db58f3d1b5099606ffa) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:41.151408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a108fe-e551-4c34-a6c3-9bac5266e6e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:41.152859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a108fe-e551-4c34-a6c3-9bac5266e6e1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:41.170727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 554/1100] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:41 2022] GET /identity/v3/role_assignments?user.id=2c6603b106fa4db58f3d1b5099606ffa&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=62b08115f7ca4b06851d82da540fc071 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:41.406027 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e6644-ab35-4d88-a7e4-c7f9f3778c10 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:41.512232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e6644-ab35-4d88-a7e4-c7f9f3778c10 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:41.546403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127a78c-e1e2-4b3d-b27f-abf0a46deab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:41.547079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127a78c-e1e2-4b3d-b27f-abf0a46deab4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:41.547336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127a78c-e1e2-4b3d-b27f-abf0a46deab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:41.547616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127a78c-e1e2-4b3d-b27f-abf0a46deab4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:41.558001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127a78c-e1e2-4b3d-b27f-abf0a46deab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2127a78c-e1e2-4b3d-b27f-abf0a46deab4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:22:41.562786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:22:41.563769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:22:41.565153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 547/1101] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:22:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:22:41.570610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a108fe-e551-4c34-a6c3-9bac5266e6e1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:41.678504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a108fe-e551-4c34-a6c3-9bac5266e6e1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:41.711435 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752db350-a1a5-4773-92d3-77eb32fa19fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:41.712068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752db350-a1a5-4773-92d3-77eb32fa19fa None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:41.712301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752db350-a1a5-4773-92d3-77eb32fa19fa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:41.712563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752db350-a1a5-4773-92d3-77eb32fa19fa None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:41.714809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752db350-a1a5-4773-92d3-77eb32fa19fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:41.714809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752db350-a1a5-4773-92d3-77eb32fa19fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:41.715028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752db350-a1a5-4773-92d3-77eb32fa19fa None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:41.719905 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:41.725557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 555/1102] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:22:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:41.731384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127a78c-e1e2-4b3d-b27f-abf0a46deab4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:41.745331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:41.834977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127a78c-e1e2-4b3d-b27f-abf0a46deab4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:41.869185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a535a-87e7-4c82-a4f1-462fe1557bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:41.869812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a535a-87e7-4c82-a4f1-462fe1557bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:41.870083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a535a-87e7-4c82-a4f1-462fe1557bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:41.870352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a535a-87e7-4c82-a4f1-462fe1557bd5 None admin] PATH_INFO: `/v3/users/c1e6c9c251154c6a8ebfcbccb0120942` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:41.871493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a535a-87e7-4c82-a4f1-462fe1557bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e6c9c251154c6a8ebfcbccb0120942)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:41.872924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a535a-87e7-4c82-a4f1-462fe1557bd5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:41.874484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 548/1103] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:22:41 2022] GET /identity/v3/users/c1e6c9c251154c6a8ebfcbccb0120942 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:22:41.881123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752db350-a1a5-4773-92d3-77eb32fa19fa None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:41.984532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752db350-a1a5-4773-92d3-77eb32fa19fa None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:42.018769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff140-84b6-4bc4-90bf-77b938ecde5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:42.019373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff140-84b6-4bc4-90bf-77b938ecde5f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:42.019648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff140-84b6-4bc4-90bf-77b938ecde5f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:42.019917 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff140-84b6-4bc4-90bf-77b938ecde5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:42.082608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:42.084954 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dff140-84b6-4bc4-90bf-77b938ecde5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:42.086710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dff140-84b6-4bc4-90bf-77b938ecde5f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:42.180605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 556/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:22:42.186544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a535a-87e7-4c82-a4f1-462fe1557bd5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:42.260527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:42.281514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a535a-87e7-4c82-a4f1-462fe1557bd5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:42.323439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c3917-fadf-49ef-bf9f-1cac16e72c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:42.324046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3917-fadf-49ef-bf9f-1cac16e72c71 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:42.324322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3917-fadf-49ef-bf9f-1cac16e72c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:42.324590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3917-fadf-49ef-bf9f-1cac16e72c71 None admin] PATH_INFO: `/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:42.325683 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c3917-fadf-49ef-bf9f-1cac16e72c71 None admin] RBAC: Authorizing `identity:get_project(project_id=38a7d280fba142cca7bf4c9c4e99cd4a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:42.327151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c3917-fadf-49ef-bf9f-1cac16e72c71 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:42.328756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 549/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:22:42 2022] GET /identity/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:42.335674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff140-84b6-4bc4-90bf-77b938ecde5f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:42.430262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:42.433271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff140-84b6-4bc4-90bf-77b938ecde5f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:42.467135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bafd8c-1b45-4d3d-a789-22bebfaea0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:42.467756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bafd8c-1b45-4d3d-a789-22bebfaea0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:42.468034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bafd8c-1b45-4d3d-a789-22bebfaea0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:42.468305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bafd8c-1b45-4d3d-a789-22bebfaea0a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:42.469024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bafd8c-1b45-4d3d-a789-22bebfaea0a3 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=38a7d280fba142cca7bf4c9c4e99cd4a, user.id=c1e6c9c251154c6a8ebfcbccb0120942) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:42.469330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bafd8c-1b45-4d3d-a789-22bebfaea0a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:42.470830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bafd8c-1b45-4d3d-a789-22bebfaea0a3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:42.476463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 557/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:42 2022] GET /identity/v3/role_assignments?user.id=c1e6c9c251154c6a8ebfcbccb0120942&scope.project.id=38a7d280fba142cca7bf4c9c4e99cd4a&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:44.683538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd73e-dfd6-445c-9cd9-358c1224b41e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:44.684064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd73e-dfd6-445c-9cd9-358c1224b41e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:44.684064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd73e-dfd6-445c-9cd9-358c1224b41e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:44.685394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 550/1107] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:44.690866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ba9d0-270e-425f-97d1-aec57dea810b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:44.691304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ba9d0-270e-425f-97d1-aec57dea810b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:44.691400 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ba9d0-270e-425f-97d1-aec57dea810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:44.708887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-980ba9d0-270e-425f-97d1-aec57dea810b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:44.710058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-980ba9d0-270e-425f-97d1-aec57dea810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:44.772301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 558/1108] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:45.045307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cd73e-dfd6-445c-9cd9-358c1224b41e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:45.142512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cd73e-dfd6-445c-9cd9-358c1224b41e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:45.175001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d568f-493f-4140-baf6-6bf866f5a3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:45.175606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d568f-493f-4140-baf6-6bf866f5a3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:45.175882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d568f-493f-4140-baf6-6bf866f5a3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:45.176147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d568f-493f-4140-baf6-6bf866f5a3b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:45.177230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d568f-493f-4140-baf6-6bf866f5a3b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:45.178649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d568f-493f-4140-baf6-6bf866f5a3b3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:45.180198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 551/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:45.185856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ba9d0-270e-425f-97d1-aec57dea810b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:45.277006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:45.284565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ba9d0-270e-425f-97d1-aec57dea810b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:45.317069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6183-95e2-4958-9cbe-6ee560853c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:45.317597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6183-95e2-4958-9cbe-6ee560853c32 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:45.317873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6183-95e2-4958-9cbe-6ee560853c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:45.318143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6183-95e2-4958-9cbe-6ee560853c32 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:45.318803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f6183-95e2-4958-9cbe-6ee560853c32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:45.320216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f6183-95e2-4958-9cbe-6ee560853c32 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:45.341703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 559/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:22:45 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:22:47.519141 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cdf72-67f2-4804-8280-580da5ce6247 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:47.519591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cdf72-67f2-4804-8280-580da5ce6247 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:47.519708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cdf72-67f2-4804-8280-580da5ce6247 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:47.520999 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 552/1111] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:47.526255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658f1f8-c346-430d-9359-b821b31a55db None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:47.526635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658f1f8-c346-430d-9359-b821b31a55db None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:47.526853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658f1f8-c346-430d-9359-b821b31a55db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:47.545148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7658f1f8-c346-430d-9359-b821b31a55db None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:47.546328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7658f1f8-c346-430d-9359-b821b31a55db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:47.610091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 560/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:47.878966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cdf72-67f2-4804-8280-580da5ce6247 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:47.893986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:47.975547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cdf72-67f2-4804-8280-580da5ce6247 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:48.010359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91051791-3f3a-4bd6-b332-3d5b94751839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:48.011003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91051791-3f3a-4bd6-b332-3d5b94751839 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:48.011281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91051791-3f3a-4bd6-b332-3d5b94751839 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:48.011549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91051791-3f3a-4bd6-b332-3d5b94751839 None admin] PATH_INFO: `/v3/roles/8bc105194aae4f11b5a2b917bb621f1f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:48.012906 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91051791-3f3a-4bd6-b332-3d5b94751839 None admin] RBAC: Authorizing `identity:get_role(role_id=8bc105194aae4f11b5a2b917bb621f1f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:48.014264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91051791-3f3a-4bd6-b332-3d5b94751839 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:48.015595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 553/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:22:47 2022] GET /identity/v3/roles/8bc105194aae4f11b5a2b917bb621f1f => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:48.021660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658f1f8-c346-430d-9359-b821b31a55db None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:48.097663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:48.116887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658f1f8-c346-430d-9359-b821b31a55db None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:48.149502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400fc34-a826-4999-9876-623bb03b4dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:48.150055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400fc34-a826-4999-9876-623bb03b4dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:48.150335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400fc34-a826-4999-9876-623bb03b4dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:48.150610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400fc34-a826-4999-9876-623bb03b4dd5 None admin] PATH_INFO: `/v3/users/3d4cafa75d9e4b049f031ea92194ed44` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:48.163991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400fc34-a826-4999-9876-623bb03b4dd5 None admin] RBAC: Authorizing `identity:get_user(user_id=3d4cafa75d9e4b049f031ea92194ed44)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:48.165418 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400fc34-a826-4999-9876-623bb03b4dd5 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:48.167045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 561/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:22:48 2022] GET /identity/v3/users/3d4cafa75d9e4b049f031ea92194ed44 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:48.172738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91051791-3f3a-4bd6-b332-3d5b94751839 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:48.251289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:48.268644 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91051791-3f3a-4bd6-b332-3d5b94751839 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:48.301739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25099ee1-8915-4cf5-9d3f-8744361dd8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:48.302334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25099ee1-8915-4cf5-9d3f-8744361dd8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:48.302614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25099ee1-8915-4cf5-9d3f-8744361dd8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:48.302915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25099ee1-8915-4cf5-9d3f-8744361dd8a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:48.366245 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25099ee1-8915-4cf5-9d3f-8744361dd8a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:48.367720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25099ee1-8915-4cf5-9d3f-8744361dd8a3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:48.444457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:48.462250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 554/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:22:48.468134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400fc34-a826-4999-9876-623bb03b4dd5 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:48.563967 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400fc34-a826-4999-9876-623bb03b4dd5 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:48.597030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aac94-e258-43b5-9e21-ad32a19e84e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:48.597646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aac94-e258-43b5-9e21-ad32a19e84e0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:48.597927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aac94-e258-43b5-9e21-ad32a19e84e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:48.598200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aac94-e258-43b5-9e21-ad32a19e84e0 None admin] PATH_INFO: `/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:48.599319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aac94-e258-43b5-9e21-ad32a19e84e0 None admin] RBAC: Authorizing `identity:get_project(project_id=38a7d280fba142cca7bf4c9c4e99cd4a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:48.600737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aac94-e258-43b5-9e21-ad32a19e84e0 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:48.602328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 562/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:22:48 2022] GET /identity/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:48.608577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25099ee1-8915-4cf5-9d3f-8744361dd8a3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:48.711719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25099ee1-8915-4cf5-9d3f-8744361dd8a3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:48.745539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81d617-727f-4e79-a855-79b8e291824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:48.746155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81d617-727f-4e79-a855-79b8e291824f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:48.746441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81d617-727f-4e79-a855-79b8e291824f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:48.746735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81d617-727f-4e79-a855-79b8e291824f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:48.747452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81d617-727f-4e79-a855-79b8e291824f None admin] RBAC: Adding query filter params (role.id=8bc105194aae4f11b5a2b917bb621f1f, scope.project.id=38a7d280fba142cca7bf4c9c4e99cd4a, user.id=3d4cafa75d9e4b049f031ea92194ed44) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:48.747767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81d617-727f-4e79-a855-79b8e291824f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:48.749189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81d617-727f-4e79-a855-79b8e291824f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:48.754758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 555/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:48 2022] GET /identity/v3/role_assignments?user.id=3d4cafa75d9e4b049f031ea92194ed44&scope.project.id=38a7d280fba142cca7bf4c9c4e99cd4a&role.id=8bc105194aae4f11b5a2b917bb621f1f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:50.853480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be06d-5b00-4065-8daf-47dd8cf41566 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:50.853980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be06d-5b00-4065-8daf-47dd8cf41566 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:50.853980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be06d-5b00-4065-8daf-47dd8cf41566 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:50.855312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 563/1118] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:50.860306 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05cf23-022a-4d07-8851-98844022a290 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:50.860767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05cf23-022a-4d07-8851-98844022a290 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:50.860861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05cf23-022a-4d07-8851-98844022a290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:50.879339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3d05cf23-022a-4d07-8851-98844022a290 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:50.880510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3d05cf23-022a-4d07-8851-98844022a290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:50.920853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:50.945172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 556/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:51.211416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337be06d-5b00-4065-8daf-47dd8cf41566 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:51.220285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:51.308688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337be06d-5b00-4065-8daf-47dd8cf41566 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:51.341649 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c539709-47f3-463e-9c4c-4e57d972e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:51.342255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c539709-47f3-463e-9c4c-4e57d972e13f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:51.342531 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c539709-47f3-463e-9c4c-4e57d972e13f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:51.342831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c539709-47f3-463e-9c4c-4e57d972e13f None admin] PATH_INFO: `/v3/roles/8bc105194aae4f11b5a2b917bb621f1f` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:51.344195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c539709-47f3-463e-9c4c-4e57d972e13f None admin] RBAC: Authorizing `identity:get_role(role_id=8bc105194aae4f11b5a2b917bb621f1f)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:51.345899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c539709-47f3-463e-9c4c-4e57d972e13f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:51.347229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 564/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:22:51 2022] GET /identity/v3/roles/8bc105194aae4f11b5a2b917bb621f1f => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:51.353045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05cf23-022a-4d07-8851-98844022a290 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:51.447748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05cf23-022a-4d07-8851-98844022a290 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:51.480472 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd061e-b4d2-4738-8d89-6f17622dfac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:51.481092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd061e-b4d2-4738-8d89-6f17622dfac5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:51.481369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd061e-b4d2-4738-8d89-6f17622dfac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:51.481637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd061e-b4d2-4738-8d89-6f17622dfac5 None admin] PATH_INFO: `/v3/users/3d4cafa75d9e4b049f031ea92194ed44` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:51.482748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd061e-b4d2-4738-8d89-6f17622dfac5 None admin] RBAC: Authorizing `identity:get_user(user_id=3d4cafa75d9e4b049f031ea92194ed44)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:51.484172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd061e-b4d2-4738-8d89-6f17622dfac5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:51.485953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 557/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:22:51 2022] GET /identity/v3/users/3d4cafa75d9e4b049f031ea92194ed44 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:51.491540 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c539709-47f3-463e-9c4c-4e57d972e13f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:51.562288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:51.586772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c539709-47f3-463e-9c4c-4e57d972e13f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:51.618658 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32837e92-c00e-4b28-99fc-5878c7fdc859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:51.619295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32837e92-c00e-4b28-99fc-5878c7fdc859 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:51.619569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32837e92-c00e-4b28-99fc-5878c7fdc859 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:51.619834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32837e92-c00e-4b28-99fc-5878c7fdc859 None admin] PATH_INFO: `/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:51.620920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32837e92-c00e-4b28-99fc-5878c7fdc859 None admin] RBAC: Authorizing `identity:get_project(project_id=38a7d280fba142cca7bf4c9c4e99cd4a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:51.622319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32837e92-c00e-4b28-99fc-5878c7fdc859 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:51.623930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 565/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:22:51 2022] GET /identity/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:51.630344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd061e-b4d2-4738-8d89-6f17622dfac5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:51.674401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:51.726811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd061e-b4d2-4738-8d89-6f17622dfac5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:51.759796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b911c60-4334-4d54-934a-3529cf3e6b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:51.760432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b911c60-4334-4d54-934a-3529cf3e6b19 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:51.760711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b911c60-4334-4d54-934a-3529cf3e6b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:51.760982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b911c60-4334-4d54-934a-3529cf3e6b19 None admin] PATH_INFO: `/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a/users/3d4cafa75d9e4b049f031ea92194ed44/roles/8bc105194aae4f11b5a2b917bb621f1f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:51.763112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b911c60-4334-4d54-934a-3529cf3e6b19 None admin] RBAC: Authorizing `identity:create_grant(project_id=38a7d280fba142cca7bf4c9c4e99cd4a, user_id=3d4cafa75d9e4b049f031ea92194ed44, role_id=8bc105194aae4f11b5a2b917bb621f1f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:51.764540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b911c60-4334-4d54-934a-3529cf3e6b19 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:51.777144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 558/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:22:51 2022] PUT /identity/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a/users/3d4cafa75d9e4b049f031ea92194ed44/roles/8bc105194aae4f11b5a2b917bb621f1f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:22:53.870117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aac1e-59e3-49a9-ba55-b6161305d880 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:53.870628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aac1e-59e3-49a9-ba55-b6161305d880 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:53.870628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aac1e-59e3-49a9-ba55-b6161305d880 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:53.871932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 566/1124] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:53.877470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42b643-e789-44f7-896a-0b0cd22388fe None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:53.877883 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42b643-e789-44f7-896a-0b0cd22388fe None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:53.878021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42b643-e789-44f7-896a-0b0cd22388fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:53.896270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2f42b643-e789-44f7-896a-0b0cd22388fe None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:53.897456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2f42b643-e789-44f7-896a-0b0cd22388fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:53.961702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 559/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:22:54.230826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952aac1e-59e3-49a9-ba55-b6161305d880 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:54.326758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952aac1e-59e3-49a9-ba55-b6161305d880 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:54.359060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e134a1b-3ffc-49a2-9438-71842f8d070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:54.359665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e134a1b-3ffc-49a2-9438-71842f8d070a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:54.359939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e134a1b-3ffc-49a2-9438-71842f8d070a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:54.360251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e134a1b-3ffc-49a2-9438-71842f8d070a None admin] PATH_INFO: `/v3/roles/8bc105194aae4f11b5a2b917bb621f1f` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:54.361862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e134a1b-3ffc-49a2-9438-71842f8d070a None admin] RBAC: Authorizing `identity:get_role(role_id=8bc105194aae4f11b5a2b917bb621f1f)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:54.363239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e134a1b-3ffc-49a2-9438-71842f8d070a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:54.364526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 567/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:22:54 2022] GET /identity/v3/roles/8bc105194aae4f11b5a2b917bb621f1f => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:54.370179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42b643-e789-44f7-896a-0b0cd22388fe None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:54.402898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:54.467578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42b643-e789-44f7-896a-0b0cd22388fe None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:54.500228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525ea7a-655f-40f4-b8f2-5694e97d7a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:54.501314 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ea7a-655f-40f4-b8f2-5694e97d7a29 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:54.501618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ea7a-655f-40f4-b8f2-5694e97d7a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:54.501895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ea7a-655f-40f4-b8f2-5694e97d7a29 None admin] PATH_INFO: `/v3/users/3d4cafa75d9e4b049f031ea92194ed44` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:54.503047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525ea7a-655f-40f4-b8f2-5694e97d7a29 None admin] RBAC: Authorizing `identity:get_user(user_id=3d4cafa75d9e4b049f031ea92194ed44)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:54.504475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525ea7a-655f-40f4-b8f2-5694e97d7a29 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:54.506034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 560/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:22:54 2022] GET /identity/v3/users/3d4cafa75d9e4b049f031ea92194ed44 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:54.511779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e134a1b-3ffc-49a2-9438-71842f8d070a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:54.524217 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:54.612053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e134a1b-3ffc-49a2-9438-71842f8d070a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:54.645277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf74a19-d438-4fb8-bae2-1ef28469aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:54.645866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74a19-d438-4fb8-bae2-1ef28469aa63 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:54.646166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74a19-d438-4fb8-bae2-1ef28469aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:54.646431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74a19-d438-4fb8-bae2-1ef28469aa63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:54.709157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf74a19-d438-4fb8-bae2-1ef28469aa63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:54.710581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf74a19-d438-4fb8-bae2-1ef28469aa63 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:54.720865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:54.803771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 568/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:22:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:22:54.809572 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525ea7a-655f-40f4-b8f2-5694e97d7a29 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:54.903390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525ea7a-655f-40f4-b8f2-5694e97d7a29 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:54.904855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:54.939265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cb638-752b-4287-92b4-095ab1a1a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:54.939877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cb638-752b-4287-92b4-095ab1a1a236 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:54.940154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cb638-752b-4287-92b4-095ab1a1a236 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:54.940421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cb638-752b-4287-92b4-095ab1a1a236 None admin] PATH_INFO: `/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:54.941510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cb638-752b-4287-92b4-095ab1a1a236 None admin] RBAC: Authorizing `identity:get_project(project_id=38a7d280fba142cca7bf4c9c4e99cd4a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:54.942961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cb638-752b-4287-92b4-095ab1a1a236 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:54.944552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 561/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:22:54 2022] GET /identity/v3/projects/38a7d280fba142cca7bf4c9c4e99cd4a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:54.950713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf74a19-d438-4fb8-bae2-1ef28469aa63 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:55.043786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf74a19-d438-4fb8-bae2-1ef28469aa63 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:55.054653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:55.077253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4345f6-aa5e-41e2-b009-6b75c5951dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:55.077839 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4345f6-aa5e-41e2-b009-6b75c5951dee None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:55.078112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4345f6-aa5e-41e2-b009-6b75c5951dee None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:55.078378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4345f6-aa5e-41e2-b009-6b75c5951dee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:55.079156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4345f6-aa5e-41e2-b009-6b75c5951dee None admin] RBAC: Adding query filter params (role.id=8bc105194aae4f11b5a2b917bb621f1f, scope.project.id=38a7d280fba142cca7bf4c9c4e99cd4a, user.id=3d4cafa75d9e4b049f031ea92194ed44) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:22:55.079462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4345f6-aa5e-41e2-b009-6b75c5951dee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:55.080873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4345f6-aa5e-41e2-b009-6b75c5951dee None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:55.086363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 569/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:22:54 2022] GET /identity/v3/role_assignments?user.id=3d4cafa75d9e4b049f031ea92194ed44&scope.project.id=38a7d280fba142cca7bf4c9c4e99cd4a&role.id=8bc105194aae4f11b5a2b917bb621f1f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:57.233526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e4157-9aa8-4fa6-b1b1-6d652e9c9295 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:57.234091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e4157-9aa8-4fa6-b1b1-6d652e9c9295 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:57.234091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e4157-9aa8-4fa6-b1b1-6d652e9c9295 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:57.235482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 562/1131] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:22:57.240614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccdc8e-b665-440b-85b6-c9eda71b0627 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:57.240981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccdc8e-b665-440b-85b6-c9eda71b0627 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:57.241169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccdc8e-b665-440b-85b6-c9eda71b0627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:57.259337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-79ccdc8e-b665-440b-85b6-c9eda71b0627 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:22:57.260522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-79ccdc8e-b665-440b-85b6-c9eda71b0627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:22:57.323534 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 570/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:22:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:22:57.590274 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e4157-9aa8-4fa6-b1b1-6d652e9c9295 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:57.686767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e4157-9aa8-4fa6-b1b1-6d652e9c9295 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:57.718565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de31dae-65d6-494e-be10-69269a0df4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:57.719193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de31dae-65d6-494e-be10-69269a0df4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:57.719496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de31dae-65d6-494e-be10-69269a0df4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:57.719872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de31dae-65d6-494e-be10-69269a0df4d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:57.721010 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de31dae-65d6-494e-be10-69269a0df4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:57.722424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de31dae-65d6-494e-be10-69269a0df4d8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:57.723966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 563/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:22:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:22:57.729713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccdc8e-b665-440b-85b6-c9eda71b0627 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:22:57.826350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccdc8e-b665-440b-85b6-c9eda71b0627 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:22:57.828645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:22:57.859698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d707388-836b-4422-897e-58837fa87bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:22:57.860812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d707388-836b-4422-897e-58837fa87bff None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:22:57.861091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d707388-836b-4422-897e-58837fa87bff None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:22:57.861363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d707388-836b-4422-897e-58837fa87bff None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:22:57.862013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d707388-836b-4422-897e-58837fa87bff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:22:57.863459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d707388-836b-4422-897e-58837fa87bff None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:22:57.889777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 571/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:22:57 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:23:00.077342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59385b-cf7e-4aae-a2da-65891661295f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:00.077879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59385b-cf7e-4aae-a2da-65891661295f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:00.077879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59385b-cf7e-4aae-a2da-65891661295f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:00.079806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 564/1135] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:00.085308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e14d3-2ad5-48b6-a1c2-91ec57db9f1f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:00.085760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e14d3-2ad5-48b6-a1c2-91ec57db9f1f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:00.085867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e14d3-2ad5-48b6-a1c2-91ec57db9f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:00.105115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3c7e14d3-2ad5-48b6-a1c2-91ec57db9f1f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:00.106285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3c7e14d3-2ad5-48b6-a1c2-91ec57db9f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:00.172355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 572/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:00.443608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59385b-cf7e-4aae-a2da-65891661295f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:00.483583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:00.541745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59385b-cf7e-4aae-a2da-65891661295f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:00.574713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffa850-21eb-43fb-a2ed-5f3674304435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:00.575326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffa850-21eb-43fb-a2ed-5f3674304435 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:00.575602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffa850-21eb-43fb-a2ed-5f3674304435 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:00.575871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffa850-21eb-43fb-a2ed-5f3674304435 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:00.576945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffa850-21eb-43fb-a2ed-5f3674304435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:00.578370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffa850-21eb-43fb-a2ed-5f3674304435 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:00.579963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 565/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:23:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:00.585789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e14d3-2ad5-48b6-a1c2-91ec57db9f1f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:00.665333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:00.680862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e14d3-2ad5-48b6-a1c2-91ec57db9f1f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:00.714514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e411e49-8838-4eea-ac6a-a023ad29653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:00.715067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e411e49-8838-4eea-ac6a-a023ad29653c None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:00.715347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e411e49-8838-4eea-ac6a-a023ad29653c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:00.715618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e411e49-8838-4eea-ac6a-a023ad29653c None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:00.716256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e411e49-8838-4eea-ac6a-a023ad29653c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:00.717682 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e411e49-8838-4eea-ac6a-a023ad29653c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:00.738318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 573/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:23:00 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:23:02.914954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f72b8-c3fe-4078-bea8-28040a59ad83 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:02.915456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f72b8-c3fe-4078-bea8-28040a59ad83 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:02.915456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f72b8-c3fe-4078-bea8-28040a59ad83 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:02.916748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 566/1139] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:02.922087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50a697-e9b9-40e3-ac83-9a1119cace27 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:02.923022 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50a697-e9b9-40e3-ac83-9a1119cace27 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:02.923200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50a697-e9b9-40e3-ac83-9a1119cace27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:02.941678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6e50a697-e9b9-40e3-ac83-9a1119cace27 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:02.942875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6e50a697-e9b9-40e3-ac83-9a1119cace27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:03.005335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 574/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:03.275069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f72b8-c3fe-4078-bea8-28040a59ad83 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:03.371232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f72b8-c3fe-4078-bea8-28040a59ad83 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:03.378839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:03.410152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ee3ce-1d99-4c82-923e-b545fa72c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:03.410799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ee3ce-1d99-4c82-923e-b545fa72c21b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:03.411078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ee3ce-1d99-4c82-923e-b545fa72c21b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:03.411348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ee3ce-1d99-4c82-923e-b545fa72c21b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:03.421240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ee3ce-1d99-4c82-923e-b545fa72c21b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d57ee3ce-1d99-4c82-923e-b545fa72c21b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:23:03.426254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:23:03.427395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:23:03.428265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 567/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:23:03.433571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50a697-e9b9-40e3-ac83-9a1119cace27 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:03.502607 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:03.531108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50a697-e9b9-40e3-ac83-9a1119cace27 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:03.564583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cf63d-81cc-4eb3-a4e1-3d57c45f2005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:03.565174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cf63d-81cc-4eb3-a4e1-3d57c45f2005 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:03.565452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cf63d-81cc-4eb3-a4e1-3d57c45f2005 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:03.565721 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cf63d-81cc-4eb3-a4e1-3d57c45f2005 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:03.566375 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cf63d-81cc-4eb3-a4e1-3d57c45f2005 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:03.566706 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cf63d-81cc-4eb3-a4e1-3d57c45f2005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:03.568053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cf63d-81cc-4eb3-a4e1-3d57c45f2005 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:03.575690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 575/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:23:03.581561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ee3ce-1d99-4c82-923e-b545fa72c21b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:03.676388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ee3ce-1d99-4c82-923e-b545fa72c21b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:03.708641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d1aa-f00c-47fb-9d39-f86d377debe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:03.709240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d1aa-f00c-47fb-9d39-f86d377debe2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:03.709519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d1aa-f00c-47fb-9d39-f86d377debe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:03.709786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d1aa-f00c-47fb-9d39-f86d377debe2 None admin] PATH_INFO: `/v3/users/3b7c9b5def104278b1d9fb400a5a4063` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:03.722341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873d1aa-f00c-47fb-9d39-f86d377debe2 None admin] RBAC: Authorizing `identity:get_user(user_id=3b7c9b5def104278b1d9fb400a5a4063)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:03.723789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873d1aa-f00c-47fb-9d39-f86d377debe2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:03.725332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 568/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:23:03 2022] GET /identity/v3/users/3b7c9b5def104278b1d9fb400a5a4063 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:03.731313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cf63d-81cc-4eb3-a4e1-3d57c45f2005 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:03.827795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cf63d-81cc-4eb3-a4e1-3d57c45f2005 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:03.860046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9553-0950-4f60-a1ae-6c19f122377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:03.860628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9553-0950-4f60-a1ae-6c19f122377f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:03.860908 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9553-0950-4f60-a1ae-6c19f122377f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:03.861180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9553-0950-4f60-a1ae-6c19f122377f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:03.863674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:03.925968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd9553-0950-4f60-a1ae-6c19f122377f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:03.927432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd9553-0950-4f60-a1ae-6c19f122377f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:04.020989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 576/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:23:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:23:04.026969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d1aa-f00c-47fb-9d39-f86d377debe2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:04.051402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:04.121452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d1aa-f00c-47fb-9d39-f86d377debe2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:04.153802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71dad8-9e57-4407-9784-85ce1aae86a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:04.154405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71dad8-9e57-4407-9784-85ce1aae86a8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:04.154703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71dad8-9e57-4407-9784-85ce1aae86a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:04.154978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71dad8-9e57-4407-9784-85ce1aae86a8 None admin] PATH_INFO: `/v3/projects/fdd273efa49d4c4b80af74bf30b3ae46` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:04.156062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71dad8-9e57-4407-9784-85ce1aae86a8 None admin] RBAC: Authorizing `identity:get_project(project_id=fdd273efa49d4c4b80af74bf30b3ae46)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:04.157501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71dad8-9e57-4407-9784-85ce1aae86a8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:04.159115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 569/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:23:04 2022] GET /identity/v3/projects/fdd273efa49d4c4b80af74bf30b3ae46 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:04.165277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9553-0950-4f60-a1ae-6c19f122377f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:04.197576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:04.260334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9553-0950-4f60-a1ae-6c19f122377f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:04.293017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc518345-05a0-4f9c-865a-79337c6d0105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:04.293605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc518345-05a0-4f9c-865a-79337c6d0105 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:04.293878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc518345-05a0-4f9c-865a-79337c6d0105 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:04.294145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc518345-05a0-4f9c-865a-79337c6d0105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:04.294881 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc518345-05a0-4f9c-865a-79337c6d0105 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=fdd273efa49d4c4b80af74bf30b3ae46, user.id=3b7c9b5def104278b1d9fb400a5a4063) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:04.295185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc518345-05a0-4f9c-865a-79337c6d0105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:04.296589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc518345-05a0-4f9c-865a-79337c6d0105 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:04.302633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 577/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:23:04 2022] GET /identity/v3/role_assignments?user.id=3b7c9b5def104278b1d9fb400a5a4063&scope.project.id=fdd273efa49d4c4b80af74bf30b3ae46&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:06.388773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14a26-19f2-45f0-bb86-5611d680104c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:06.389420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14a26-19f2-45f0-bb86-5611d680104c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:06.389420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14a26-19f2-45f0-bb86-5611d680104c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:06.390630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 570/1147] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:06.396024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8141c0-b6b2-4759-8b62-3e5d9b83131c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:06.396419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8141c0-b6b2-4759-8b62-3e5d9b83131c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:06.396572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8141c0-b6b2-4759-8b62-3e5d9b83131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:06.414774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fc8141c0-b6b2-4759-8b62-3e5d9b83131c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:06.415941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fc8141c0-b6b2-4759-8b62-3e5d9b83131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:06.479361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 578/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:06.745248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14a26-19f2-45f0-bb86-5611d680104c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:06.834325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:06.844922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14a26-19f2-45f0-bb86-5611d680104c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:06.876860 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b73ee-009c-4145-af06-e9beebdb1777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:06.877466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b73ee-009c-4145-af06-e9beebdb1777 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:06.877743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b73ee-009c-4145-af06-e9beebdb1777 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:06.878013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b73ee-009c-4145-af06-e9beebdb1777 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:06.887622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b73ee-009c-4145-af06-e9beebdb1777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3e6b73ee-009c-4145-af06-e9beebdb1777 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:23:06.892837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:23:06.894001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:23:06.894974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 571/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:23:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:23:06.900124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8141c0-b6b2-4759-8b62-3e5d9b83131c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:06.927184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:06.995020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8141c0-b6b2-4759-8b62-3e5d9b83131c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:07.027426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7cf7f-8fa5-4b01-b1d6-ad3fd2c52074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:07.027956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7cf7f-8fa5-4b01-b1d6-ad3fd2c52074 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:07.028229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7cf7f-8fa5-4b01-b1d6-ad3fd2c52074 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:07.028494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7cf7f-8fa5-4b01-b1d6-ad3fd2c52074 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:07.029140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7cf7f-8fa5-4b01-b1d6-ad3fd2c52074 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:07.029438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7cf7f-8fa5-4b01-b1d6-ad3fd2c52074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:07.030800 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7cf7f-8fa5-4b01-b1d6-ad3fd2c52074 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:07.038381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 579/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:23:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:07.044292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b73ee-009c-4145-af06-e9beebdb1777 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:07.142490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b73ee-009c-4145-af06-e9beebdb1777 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:07.176110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84ec05-3468-46d3-9d37-80e8573c07f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:07.176726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ec05-3468-46d3-9d37-80e8573c07f7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:07.177006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ec05-3468-46d3-9d37-80e8573c07f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:07.177279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ec05-3468-46d3-9d37-80e8573c07f7 None admin] PATH_INFO: `/v3/users/3b7c9b5def104278b1d9fb400a5a4063` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:07.178379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84ec05-3468-46d3-9d37-80e8573c07f7 None admin] RBAC: Authorizing `identity:get_user(user_id=3b7c9b5def104278b1d9fb400a5a4063)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:07.179839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84ec05-3468-46d3-9d37-80e8573c07f7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:07.181396 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 572/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:23:07 2022] GET /identity/v3/users/3b7c9b5def104278b1d9fb400a5a4063 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:07.187130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7cf7f-8fa5-4b01-b1d6-ad3fd2c52074 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:07.273653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:07.283268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7cf7f-8fa5-4b01-b1d6-ad3fd2c52074 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:07.316767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be96c9-c7aa-4500-869d-a3fc6ae7b086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:07.317386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be96c9-c7aa-4500-869d-a3fc6ae7b086 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:07.317662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be96c9-c7aa-4500-869d-a3fc6ae7b086 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:07.317930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be96c9-c7aa-4500-869d-a3fc6ae7b086 None admin] PATH_INFO: `/v3/projects/fdd273efa49d4c4b80af74bf30b3ae46` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:07.319048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be96c9-c7aa-4500-869d-a3fc6ae7b086 None admin] RBAC: Authorizing `identity:get_project(project_id=fdd273efa49d4c4b80af74bf30b3ae46)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:07.320454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be96c9-c7aa-4500-869d-a3fc6ae7b086 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:07.322067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 580/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:23:07 2022] GET /identity/v3/projects/fdd273efa49d4c4b80af74bf30b3ae46 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:07.327994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84ec05-3468-46d3-9d37-80e8573c07f7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:07.349084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:07.424961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84ec05-3468-46d3-9d37-80e8573c07f7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:07.459540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafe688-4bb9-4377-a9c0-cc02710fa96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:07.460197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafe688-4bb9-4377-a9c0-cc02710fa96e None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:07.460478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafe688-4bb9-4377-a9c0-cc02710fa96e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:07.460751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafe688-4bb9-4377-a9c0-cc02710fa96e None admin] PATH_INFO: `/v3/projects/fdd273efa49d4c4b80af74bf30b3ae46/users/3b7c9b5def104278b1d9fb400a5a4063/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:07.462624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafe688-4bb9-4377-a9c0-cc02710fa96e None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd273efa49d4c4b80af74bf30b3ae46, user_id=3b7c9b5def104278b1d9fb400a5a4063, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:07.464121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafe688-4bb9-4377-a9c0-cc02710fa96e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:07.478198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 573/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:23:07 2022] PUT /identity/v3/projects/fdd273efa49d4c4b80af74bf30b3ae46/users/3b7c9b5def104278b1d9fb400a5a4063/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:23:09.592981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e27d-3b2e-400a-96da-6b039b666bca None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:09.593522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e27d-3b2e-400a-96da-6b039b666bca None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:09.593522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e27d-3b2e-400a-96da-6b039b666bca None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:09.595474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 581/1154] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:09.600757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fa88f-9120-436b-9d60-2da31bfff938 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:09.601144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fa88f-9120-436b-9d60-2da31bfff938 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:09.601296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fa88f-9120-436b-9d60-2da31bfff938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:09.618946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e77fa88f-9120-436b-9d60-2da31bfff938 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:09.620125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e77fa88f-9120-436b-9d60-2da31bfff938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:09.683539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 574/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:09.950638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e27d-3b2e-400a-96da-6b039b666bca None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:10.048591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e27d-3b2e-400a-96da-6b039b666bca None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:10.081223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fc480-6bc9-4e71-a6c6-1ff8a08c6108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:10.081831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fc480-6bc9-4e71-a6c6-1ff8a08c6108 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:10.082110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fc480-6bc9-4e71-a6c6-1ff8a08c6108 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:10.082379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fc480-6bc9-4e71-a6c6-1ff8a08c6108 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:10.092388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fc480-6bc9-4e71-a6c6-1ff8a08c6108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-431fc480-6bc9-4e71-a6c6-1ff8a08c6108 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:23:10.097182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:23:10.098282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:23:10.099517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 582/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:23:10.104105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fa88f-9120-436b-9d60-2da31bfff938 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:10.115519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:10.201624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fa88f-9120-436b-9d60-2da31bfff938 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:10.234303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c07c-4347-4a6e-bd0b-b7d4d6a9597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:10.234934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c07c-4347-4a6e-bd0b-b7d4d6a9597b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:10.235210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c07c-4347-4a6e-bd0b-b7d4d6a9597b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:10.235480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c07c-4347-4a6e-bd0b-b7d4d6a9597b None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:10.236134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915c07c-4347-4a6e-bd0b-b7d4d6a9597b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:10.236439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915c07c-4347-4a6e-bd0b-b7d4d6a9597b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:10.237829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915c07c-4347-4a6e-bd0b-b7d4d6a9597b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:10.245452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 575/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:10.251860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fc480-6bc9-4e71-a6c6-1ff8a08c6108 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:10.271986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:10.349775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fc480-6bc9-4e71-a6c6-1ff8a08c6108 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:10.381613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0333553-5f88-441c-9b9b-798bbc2aa105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:10.382234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0333553-5f88-441c-9b9b-798bbc2aa105 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:10.382510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0333553-5f88-441c-9b9b-798bbc2aa105 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:10.382807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0333553-5f88-441c-9b9b-798bbc2aa105 None admin] PATH_INFO: `/v3/users/3b7c9b5def104278b1d9fb400a5a4063` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:10.383913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0333553-5f88-441c-9b9b-798bbc2aa105 None admin] RBAC: Authorizing `identity:get_user(user_id=3b7c9b5def104278b1d9fb400a5a4063)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:10.385330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0333553-5f88-441c-9b9b-798bbc2aa105 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:10.386922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 583/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:23:10 2022] GET /identity/v3/users/3b7c9b5def104278b1d9fb400a5a4063 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:10.393224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c07c-4347-4a6e-bd0b-b7d4d6a9597b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:10.462780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:10.493805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c07c-4347-4a6e-bd0b-b7d4d6a9597b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:10.525828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee29ca-7b06-467e-b68e-4293fe126318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:10.526418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee29ca-7b06-467e-b68e-4293fe126318 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:10.526748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee29ca-7b06-467e-b68e-4293fe126318 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:10.527015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee29ca-7b06-467e-b68e-4293fe126318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:10.590486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee29ca-7b06-467e-b68e-4293fe126318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:10.591950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee29ca-7b06-467e-b68e-4293fe126318 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:10.655584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:10.685155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 576/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:23:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:23:10.691599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0333553-5f88-441c-9b9b-798bbc2aa105 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:10.772730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:10.787256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0333553-5f88-441c-9b9b-798bbc2aa105 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:10.819325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390b04e-ab42-436f-841a-f2b8f9b0ef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:10.819938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390b04e-ab42-436f-841a-f2b8f9b0ef87 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:10.820215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390b04e-ab42-436f-841a-f2b8f9b0ef87 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:10.820485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390b04e-ab42-436f-841a-f2b8f9b0ef87 None admin] PATH_INFO: `/v3/projects/fdd273efa49d4c4b80af74bf30b3ae46` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:10.821577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390b04e-ab42-436f-841a-f2b8f9b0ef87 None admin] RBAC: Authorizing `identity:get_project(project_id=fdd273efa49d4c4b80af74bf30b3ae46)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:10.823018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390b04e-ab42-436f-841a-f2b8f9b0ef87 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:10.824619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 584/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:23:10 2022] GET /identity/v3/projects/fdd273efa49d4c4b80af74bf30b3ae46 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:10.831453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee29ca-7b06-467e-b68e-4293fe126318 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:10.925722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee29ca-7b06-467e-b68e-4293fe126318 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:10.958946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bfad5-cf10-4d66-be69-f15363a76e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:10.959535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bfad5-cf10-4d66-be69-f15363a76e53 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:10.959814 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bfad5-cf10-4d66-be69-f15363a76e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:10.960086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bfad5-cf10-4d66-be69-f15363a76e53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:10.960799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bfad5-cf10-4d66-be69-f15363a76e53 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=fdd273efa49d4c4b80af74bf30b3ae46, user.id=3b7c9b5def104278b1d9fb400a5a4063) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:10.961108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bfad5-cf10-4d66-be69-f15363a76e53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:10.962526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bfad5-cf10-4d66-be69-f15363a76e53 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:10.968056 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 577/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:23:10 2022] GET /identity/v3/role_assignments?user.id=3b7c9b5def104278b1d9fb400a5a4063&scope.project.id=fdd273efa49d4c4b80af74bf30b3ae46&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:13.103251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83851274-6ce4-4317-86af-94a4d1424383 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:13.103819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83851274-6ce4-4317-86af-94a4d1424383 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:13.103819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83851274-6ce4-4317-86af-94a4d1424383 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:13.105145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 585/1162] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:13.111024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970247d-a0e1-4b6b-a972-eb3bc258d642 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:13.111454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970247d-a0e1-4b6b-a972-eb3bc258d642 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:13.111588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970247d-a0e1-4b6b-a972-eb3bc258d642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:13.129417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3970247d-a0e1-4b6b-a972-eb3bc258d642 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:13.130650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3970247d-a0e1-4b6b-a972-eb3bc258d642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:13.158937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:13.196035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 578/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:13.462361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83851274-6ce4-4317-86af-94a4d1424383 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:13.562757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83851274-6ce4-4317-86af-94a4d1424383 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:13.594649 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d7a9-5849-44dd-adf2-e2afd9c0d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:13.595267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d7a9-5849-44dd-adf2-e2afd9c0d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:13.595544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d7a9-5849-44dd-adf2-e2afd9c0d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:13.595815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d7a9-5849-44dd-adf2-e2afd9c0d1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:13.617817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:13.660216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d7a9-5849-44dd-adf2-e2afd9c0d1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:13.661646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d7a9-5849-44dd-adf2-e2afd9c0d1c9 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:13.753886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 586/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:23:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:23:13.759736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970247d-a0e1-4b6b-a972-eb3bc258d642 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:13.853285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970247d-a0e1-4b6b-a972-eb3bc258d642 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:13.885458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95863b74-08ed-46de-aeb4-87e1c65a06fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:13.886067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95863b74-08ed-46de-aeb4-87e1c65a06fe None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:13.886343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95863b74-08ed-46de-aeb4-87e1c65a06fe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:13.886613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95863b74-08ed-46de-aeb4-87e1c65a06fe None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:13.893541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95863b74-08ed-46de-aeb4-87e1c65a06fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:13.894995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95863b74-08ed-46de-aeb4-87e1c65a06fe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-95863b74-08ed-46de-aeb4-87e1c65a06fe None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:23:13.905845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:23:13.907230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:23:13.908394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 579/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Oct 4 08:23:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:23:13.912874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d7a9-5849-44dd-adf2-e2afd9c0d1c9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:13.965528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:14.008042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d7a9-5849-44dd-adf2-e2afd9c0d1c9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:14.040118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269ba7a-f970-4544-abd3-d678f57c0cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:14.040710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269ba7a-f970-4544-abd3-d678f57c0cbf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:14.040990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269ba7a-f970-4544-abd3-d678f57c0cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:14.041260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269ba7a-f970-4544-abd3-d678f57c0cbf None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:14.041890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269ba7a-f970-4544-abd3-d678f57c0cbf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:14.042190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269ba7a-f970-4544-abd3-d678f57c0cbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:14.043564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269ba7a-f970-4544-abd3-d678f57c0cbf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:14.051257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 587/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Oct 4 08:23:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:16.176512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abc2b1-159b-45e3-a405-25de1c6ddee8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:16.177047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abc2b1-159b-45e3-a405-25de1c6ddee8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:16.177047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abc2b1-159b-45e3-a405-25de1c6ddee8 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:16.178370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 580/1167] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:16.183603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e12c-8eb5-4ac8-a78f-ea91136801c4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:16.184024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e12c-8eb5-4ac8-a78f-ea91136801c4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:16.184154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e12c-8eb5-4ac8-a78f-ea91136801c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:16.202223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6d87e12c-8eb5-4ac8-a78f-ea91136801c4 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:16.204323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6d87e12c-8eb5-4ac8-a78f-ea91136801c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:16.268011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 588/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:16.535873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abc2b1-159b-45e3-a405-25de1c6ddee8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:16.564635 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:16.639061 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abc2b1-159b-45e3-a405-25de1c6ddee8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:16.675012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471762de-bfc5-4e29-80d0-baa99ca84164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:16.675542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471762de-bfc5-4e29-80d0-baa99ca84164 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:16.675828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471762de-bfc5-4e29-80d0-baa99ca84164 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:16.676103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471762de-bfc5-4e29-80d0-baa99ca84164 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:16.676770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471762de-bfc5-4e29-80d0-baa99ca84164 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:16.678140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471762de-bfc5-4e29-80d0-baa99ca84164 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:16.693342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 581/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Tue Oct 4 08:23:16 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:23:18.841788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4041c-3503-4a6a-b223-8b848dc4e84e None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:18.842289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4041c-3503-4a6a-b223-8b848dc4e84e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:18.842289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4041c-3503-4a6a-b223-8b848dc4e84e None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:18.843671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 589/1170] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:18.849000 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ffc4-b8e7-427a-a029-1093a578afbe None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:18.849414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ffc4-b8e7-427a-a029-1093a578afbe None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:18.849546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ffc4-b8e7-427a-a029-1093a578afbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:18.867691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4201ffc4-b8e7-427a-a029-1093a578afbe None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:18.868871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4201ffc4-b8e7-427a-a029-1093a578afbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:18.933646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 582/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:19.202824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4041c-3503-4a6a-b223-8b848dc4e84e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:19.251636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:19.302718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4041c-3503-4a6a-b223-8b848dc4e84e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:19.336069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41b692-7091-42bf-9b47-11958391379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:19.336683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41b692-7091-42bf-9b47-11958391379e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:19.336963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41b692-7091-42bf-9b47-11958391379e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:19.337236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41b692-7091-42bf-9b47-11958391379e None admin] PATH_INFO: `/v3/domains/4034a3d4039d4a0fa59f289c603a99a3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:19.348281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41b692-7091-42bf-9b47-11958391379e None admin] RBAC: Authorizing `identity:get_domain(domain_id=4034a3d4039d4a0fa59f289c603a99a3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:19.349718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41b692-7091-42bf-9b47-11958391379e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:19.351322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 590/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Tue Oct 4 08:23:19 2022] GET /identity/v3/domains/4034a3d4039d4a0fa59f289c603a99a3 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:19.357071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ffc4-b8e7-427a-a029-1093a578afbe None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:19.374149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:19.455605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ffc4-b8e7-427a-a029-1093a578afbe None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:19.489026 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabb508-b3f5-47d0-8c31-ca363ab4e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:19.489634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb508-b3f5-47d0-8c31-ca363ab4e88d None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:19.489918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb508-b3f5-47d0-8c31-ca363ab4e88d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:19.490194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb508-b3f5-47d0-8c31-ca363ab4e88d None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:19.490880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabb508-b3f5-47d0-8c31-ca363ab4e88d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:19.492319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabb508-b3f5-47d0-8c31-ca363ab4e88d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:19.520461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 583/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:23:19 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:23:21.671517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12470b-e2a8-454f-a00e-297eaa3cd7c1 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:21.672093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12470b-e2a8-454f-a00e-297eaa3cd7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:21.672093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12470b-e2a8-454f-a00e-297eaa3cd7c1 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:21.673376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 591/1174] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:21.678924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195ba8-44be-4b39-ace5-039246b73791 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:21.679316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195ba8-44be-4b39-ace5-039246b73791 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:21.679478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195ba8-44be-4b39-ace5-039246b73791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:21.697780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ca195ba8-44be-4b39-ace5-039246b73791 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:21.698991 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ca195ba8-44be-4b39-ace5-039246b73791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:21.757900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:21.763791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 584/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:22.035613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12470b-e2a8-454f-a00e-297eaa3cd7c1 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:22.135984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12470b-e2a8-454f-a00e-297eaa3cd7c1 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:22.144710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:22.169038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e739b-db6c-4630-9209-27fe38318473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:22.169650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e739b-db6c-4630-9209-27fe38318473 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:22.169924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e739b-db6c-4630-9209-27fe38318473 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:22.170193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e739b-db6c-4630-9209-27fe38318473 None admin] PATH_INFO: `/v3/domains/4034a3d4039d4a0fa59f289c603a99a3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:22.172189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e739b-db6c-4630-9209-27fe38318473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4034a3d4039d4a0fa59f289c603a99a3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:22.173597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e739b-db6c-4630-9209-27fe38318473 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:22.175445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 592/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Tue Oct 4 08:23:22 2022] GET /identity/v3/domains/4034a3d4039d4a0fa59f289c603a99a3 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:22.181313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195ba8-44be-4b39-ace5-039246b73791 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:22.275439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195ba8-44be-4b39-ace5-039246b73791 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:22.308336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17253c5-9dca-44a3-a7f6-7046c52c2f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:22.308870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17253c5-9dca-44a3-a7f6-7046c52c2f4d None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:22.309149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17253c5-9dca-44a3-a7f6-7046c52c2f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:22.309417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17253c5-9dca-44a3-a7f6-7046c52c2f4d None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:22.310060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17253c5-9dca-44a3-a7f6-7046c52c2f4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:22.311509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17253c5-9dca-44a3-a7f6-7046c52c2f4d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:22.332457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 585/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:23:22 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:23:24.510996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f328-d36b-4268-96d9-6ef019ebfd33 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:24.511481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f328-d36b-4268-96d9-6ef019ebfd33 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:24.511586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f328-d36b-4268-96d9-6ef019ebfd33 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:24.512857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 593/1178] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:24.518724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0df6b-9258-462f-98e0-3293de401b5c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:24.519126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0df6b-9258-462f-98e0-3293de401b5c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:24.519289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0df6b-9258-462f-98e0-3293de401b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:24.537039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-81f0df6b-9258-462f-98e0-3293de401b5c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:24.538232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-81f0df6b-9258-462f-98e0-3293de401b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:24.586802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:24.605636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 586/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:24.882134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181f328-d36b-4268-96d9-6ef019ebfd33 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:24.980122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181f328-d36b-4268-96d9-6ef019ebfd33 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:25.011678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be516a-8107-4d1f-afd8-fa1822e582d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:25.012290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be516a-8107-4d1f-afd8-fa1822e582d0 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:25.012580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be516a-8107-4d1f-afd8-fa1822e582d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:25.012837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be516a-8107-4d1f-afd8-fa1822e582d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:25.023707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be516a-8107-4d1f-afd8-fa1822e582d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-54be516a-8107-4d1f-afd8-fa1822e582d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:23:25.028421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:23:25.029511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:23:25.030654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 594/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:23:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:23:25.035926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0df6b-9258-462f-98e0-3293de401b5c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:25.131499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0df6b-9258-462f-98e0-3293de401b5c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:25.166418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2285f-9351-4bab-ad0f-3e6558900e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:25.166982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2285f-9351-4bab-ad0f-3e6558900e8c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:25.167263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2285f-9351-4bab-ad0f-3e6558900e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:25.167540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2285f-9351-4bab-ad0f-3e6558900e8c None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:25.168192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2285f-9351-4bab-ad0f-3e6558900e8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:25.168492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2285f-9351-4bab-ad0f-3e6558900e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:25.169855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2285f-9351-4bab-ad0f-3e6558900e8c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:25.178510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 587/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:25.184408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be516a-8107-4d1f-afd8-fa1822e582d0 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:25.218938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:25.280901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be516a-8107-4d1f-afd8-fa1822e582d0 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:25.313787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a68e0-1a91-4fd6-82fc-5e8b0ed68fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:25.314415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a68e0-1a91-4fd6-82fc-5e8b0ed68fba None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:25.314714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a68e0-1a91-4fd6-82fc-5e8b0ed68fba None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:25.314990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a68e0-1a91-4fd6-82fc-5e8b0ed68fba None admin] PATH_INFO: `/v3/users/b2b2ef9ce9a64502ab61e3f7e64cdb02` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:25.327431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a68e0-1a91-4fd6-82fc-5e8b0ed68fba None admin] RBAC: Authorizing `identity:get_user(user_id=b2b2ef9ce9a64502ab61e3f7e64cdb02)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:25.328972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a68e0-1a91-4fd6-82fc-5e8b0ed68fba None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:25.330558 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 595/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:23:25 2022] GET /identity/v3/users/b2b2ef9ce9a64502ab61e3f7e64cdb02 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:25.336358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2285f-9351-4bab-ad0f-3e6558900e8c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:25.382112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:25.433060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2285f-9351-4bab-ad0f-3e6558900e8c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:25.465470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012e94-a85d-4e70-8d79-c0518afdb354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:25.466077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012e94-a85d-4e70-8d79-c0518afdb354 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:25.466358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012e94-a85d-4e70-8d79-c0518afdb354 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:25.466630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012e94-a85d-4e70-8d79-c0518afdb354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:25.532912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d012e94-a85d-4e70-8d79-c0518afdb354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:25.534360 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d012e94-a85d-4e70-8d79-c0518afdb354 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:25.578761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:25.630828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 588/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:23:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:23:25.636812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a68e0-1a91-4fd6-82fc-5e8b0ed68fba None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:25.727772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:25.735309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a68e0-1a91-4fd6-82fc-5e8b0ed68fba None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:25.770206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd796d-d9b0-412d-bf73-ddcef35ccfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:25.770845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd796d-d9b0-412d-bf73-ddcef35ccfac None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:25.771128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd796d-d9b0-412d-bf73-ddcef35ccfac None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:25.771401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd796d-d9b0-412d-bf73-ddcef35ccfac None admin] PATH_INFO: `/v3/projects/a2339c3d00f4498c989dc48bd1181447` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:25.772502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd796d-d9b0-412d-bf73-ddcef35ccfac None admin] RBAC: Authorizing `identity:get_project(project_id=a2339c3d00f4498c989dc48bd1181447)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:25.773916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd796d-d9b0-412d-bf73-ddcef35ccfac None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:25.775553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 596/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:23:25 2022] GET /identity/v3/projects/a2339c3d00f4498c989dc48bd1181447 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:25.781624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012e94-a85d-4e70-8d79-c0518afdb354 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:25.877075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012e94-a85d-4e70-8d79-c0518afdb354 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:25.909516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020319a-9cea-432b-8b96-049f4410b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:25.910103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020319a-9cea-432b-8b96-049f4410b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:25.910382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020319a-9cea-432b-8b96-049f4410b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:25.910653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020319a-9cea-432b-8b96-049f4410b9f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:25.911398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020319a-9cea-432b-8b96-049f4410b9f7 None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=a2339c3d00f4498c989dc48bd1181447, user.id=b2b2ef9ce9a64502ab61e3f7e64cdb02) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:25.911708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020319a-9cea-432b-8b96-049f4410b9f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:25.913121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020319a-9cea-432b-8b96-049f4410b9f7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:25.918233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 589/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:23:25 2022] GET /identity/v3/role_assignments?user.id=b2b2ef9ce9a64502ab61e3f7e64cdb02&scope.project.id=a2339c3d00f4498c989dc48bd1181447&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:23:28.093737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9e88-28cf-4dd6-86da-f07669b98409 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:28.094268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9e88-28cf-4dd6-86da-f07669b98409 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:28.094268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9e88-28cf-4dd6-86da-f07669b98409 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:28.095667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 597/1186] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:28.100863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a662de3-7de4-426b-96e9-0c71c4b0d2a1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:28.101243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a662de3-7de4-426b-96e9-0c71c4b0d2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:28.101415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a662de3-7de4-426b-96e9-0c71c4b0d2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:28.119698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6a662de3-7de4-426b-96e9-0c71c4b0d2a1 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:28.120864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6a662de3-7de4-426b-96e9-0c71c4b0d2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:28.123558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:28.185483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 590/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:28.454565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a9e88-28cf-4dd6-86da-f07669b98409 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:28.557659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a9e88-28cf-4dd6-86da-f07669b98409 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:28.590835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0145aa-4481-41ba-ba87-aae5d315dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:28.591476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0145aa-4481-41ba-ba87-aae5d315dfaa None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:28.591865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0145aa-4481-41ba-ba87-aae5d315dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:28.592163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0145aa-4481-41ba-ba87-aae5d315dfaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:28.602298 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0145aa-4481-41ba-ba87-aae5d315dfaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-7e0145aa-4481-41ba-ba87-aae5d315dfaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:23:28.607025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:23:28.608153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:23:28.609049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 598/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:23:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:23:28.614433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a662de3-7de4-426b-96e9-0c71c4b0d2a1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:28.712469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a662de3-7de4-426b-96e9-0c71c4b0d2a1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:28.744338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260edef8-0231-4d32-87ec-a15c6872cd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:28.744924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260edef8-0231-4d32-87ec-a15c6872cd94 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:28.745199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260edef8-0231-4d32-87ec-a15c6872cd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:28.745466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260edef8-0231-4d32-87ec-a15c6872cd94 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:28.746117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260edef8-0231-4d32-87ec-a15c6872cd94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:28.746417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260edef8-0231-4d32-87ec-a15c6872cd94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:28.747798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260edef8-0231-4d32-87ec-a15c6872cd94 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:28.756091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 591/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:23:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:28.761983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0145aa-4481-41ba-ba87-aae5d315dfaa None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:28.786571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:28.870331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0145aa-4481-41ba-ba87-aae5d315dfaa None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:28.910880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9d83-7b89-418b-a083-5e883746bbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:28.911506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9d83-7b89-418b-a083-5e883746bbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:28.911787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9d83-7b89-418b-a083-5e883746bbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:28.912061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9d83-7b89-418b-a083-5e883746bbb6 None admin] PATH_INFO: `/v3/users/b2b2ef9ce9a64502ab61e3f7e64cdb02` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:28.913176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f9d83-7b89-418b-a083-5e883746bbb6 None admin] RBAC: Authorizing `identity:get_user(user_id=b2b2ef9ce9a64502ab61e3f7e64cdb02)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:28.914602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f9d83-7b89-418b-a083-5e883746bbb6 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:28.916205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 599/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:23:28 2022] GET /identity/v3/users/b2b2ef9ce9a64502ab61e3f7e64cdb02 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:28.922099 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260edef8-0231-4d32-87ec-a15c6872cd94 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:28.925221 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:29.019871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260edef8-0231-4d32-87ec-a15c6872cd94 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:29.052090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4e7c3-852f-4660-a447-cc216a51d650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:29.052697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e7c3-852f-4660-a447-cc216a51d650 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:29.052975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e7c3-852f-4660-a447-cc216a51d650 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:29.053255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e7c3-852f-4660-a447-cc216a51d650 None admin] PATH_INFO: `/v3/projects/a2339c3d00f4498c989dc48bd1181447` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:29.054334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4e7c3-852f-4660-a447-cc216a51d650 None admin] RBAC: Authorizing `identity:get_project(project_id=a2339c3d00f4498c989dc48bd1181447)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:29.055777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4e7c3-852f-4660-a447-cc216a51d650 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:29.057359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 592/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:23:28 2022] GET /identity/v3/projects/a2339c3d00f4498c989dc48bd1181447 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:29.063942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9d83-7b89-418b-a083-5e883746bbb6 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:29.150323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:29.161589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9d83-7b89-418b-a083-5e883746bbb6 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:29.196742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba41ac-e038-41d3-a4df-eee9ad9bc457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:29.197395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba41ac-e038-41d3-a4df-eee9ad9bc457 None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:29.197677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba41ac-e038-41d3-a4df-eee9ad9bc457 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:29.197953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba41ac-e038-41d3-a4df-eee9ad9bc457 None admin] PATH_INFO: `/v3/projects/a2339c3d00f4498c989dc48bd1181447/users/b2b2ef9ce9a64502ab61e3f7e64cdb02/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:29.199872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba41ac-e038-41d3-a4df-eee9ad9bc457 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2339c3d00f4498c989dc48bd1181447, user_id=b2b2ef9ce9a64502ab61e3f7e64cdb02, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:29.201291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba41ac-e038-41d3-a4df-eee9ad9bc457 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:29.213464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 600/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:23:29 2022] PUT /identity/v3/projects/a2339c3d00f4498c989dc48bd1181447/users/b2b2ef9ce9a64502ab61e3f7e64cdb02/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:23:31.442561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d7023-4214-4033-8ad8-e5a9c11bb1f3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:31.443168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d7023-4214-4033-8ad8-e5a9c11bb1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:31.443168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d7023-4214-4033-8ad8-e5a9c11bb1f3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:31.444469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 593/1193] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:23:31.449631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c90d06-0195-4890-8879-150ea4d6c339 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:31.450039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c90d06-0195-4890-8879-150ea4d6c339 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:31.450179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c90d06-0195-4890-8879-150ea4d6c339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:31.469596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-79c90d06-0195-4890-8879-150ea4d6c339 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:23:31.470330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-79c90d06-0195-4890-8879-150ea4d6c339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:23:31.534421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 601/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:23:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:23:31.812634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d7023-4214-4033-8ad8-e5a9c11bb1f3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:31.881149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:31.912465 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d7023-4214-4033-8ad8-e5a9c11bb1f3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:31.944740 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae374-bdb2-405c-ad52-aba463429f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:31.945351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae374-bdb2-405c-ad52-aba463429f69 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:31.945631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae374-bdb2-405c-ad52-aba463429f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:31.945901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae374-bdb2-405c-ad52-aba463429f69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:31.956021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae374-bdb2-405c-ad52-aba463429f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-142ae374-bdb2-405c-ad52-aba463429f69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:23:31.960754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:23:31.961694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:23:31.962571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 594/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:23:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:23:31.968366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c90d06-0195-4890-8879-150ea4d6c339 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:32.044555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:32.064346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c90d06-0195-4890-8879-150ea4d6c339 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:32.097088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190e16f-0cfc-49b5-8e6e-ec483c622224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:32.097686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190e16f-0cfc-49b5-8e6e-ec483c622224 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:32.097965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190e16f-0cfc-49b5-8e6e-ec483c622224 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:32.098236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190e16f-0cfc-49b5-8e6e-ec483c622224 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:32.098920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190e16f-0cfc-49b5-8e6e-ec483c622224 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:32.099226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190e16f-0cfc-49b5-8e6e-ec483c622224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:32.100582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190e16f-0cfc-49b5-8e6e-ec483c622224 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:32.108303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 602/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:23:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:32.114112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae374-bdb2-405c-ad52-aba463429f69 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:32.209429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae374-bdb2-405c-ad52-aba463429f69 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:32.236299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:32.242195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e225d-b6c6-4e69-96f3-24ca0685aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:32.242841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e225d-b6c6-4e69-96f3-24ca0685aac8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:32.243119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e225d-b6c6-4e69-96f3-24ca0685aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:32.243389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e225d-b6c6-4e69-96f3-24ca0685aac8 None admin] PATH_INFO: `/v3/users/b2b2ef9ce9a64502ab61e3f7e64cdb02` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:32.244482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e225d-b6c6-4e69-96f3-24ca0685aac8 None admin] RBAC: Authorizing `identity:get_user(user_id=b2b2ef9ce9a64502ab61e3f7e64cdb02)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:32.245905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e225d-b6c6-4e69-96f3-24ca0685aac8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:32.247475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 595/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Oct 4 08:23:32 2022] GET /identity/v3/users/b2b2ef9ce9a64502ab61e3f7e64cdb02 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:32.253334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190e16f-0cfc-49b5-8e6e-ec483c622224 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:32.349797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190e16f-0cfc-49b5-8e6e-ec483c622224 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:32.381304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e1141-dd29-4fbb-9313-2ff0debe5d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:32.381896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e1141-dd29-4fbb-9313-2ff0debe5d2e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:32.382175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e1141-dd29-4fbb-9313-2ff0debe5d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:32.382446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e1141-dd29-4fbb-9313-2ff0debe5d2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:32.394108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:32.448302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e1141-dd29-4fbb-9313-2ff0debe5d2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:32.449742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e1141-dd29-4fbb-9313-2ff0debe5d2e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:32.547651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 603/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:23:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:23:32.553815 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e225d-b6c6-4e69-96f3-24ca0685aac8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:32.649307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e225d-b6c6-4e69-96f3-24ca0685aac8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:32.682461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ca0dc-c99d-4179-994a-13b7415c4eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:32.683099 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ca0dc-c99d-4179-994a-13b7415c4eed None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:32.683377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ca0dc-c99d-4179-994a-13b7415c4eed None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:32.683647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ca0dc-c99d-4179-994a-13b7415c4eed None admin] PATH_INFO: `/v3/projects/a2339c3d00f4498c989dc48bd1181447` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:32.684727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ca0dc-c99d-4179-994a-13b7415c4eed None admin] RBAC: Authorizing `identity:get_project(project_id=a2339c3d00f4498c989dc48bd1181447)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:32.686375 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ca0dc-c99d-4179-994a-13b7415c4eed None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:32.688796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 596/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Oct 4 08:23:32 2022] GET /identity/v3/projects/a2339c3d00f4498c989dc48bd1181447 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:32.695054 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e1141-dd29-4fbb-9313-2ff0debe5d2e None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:23:32.737500 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:32.791211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e1141-dd29-4fbb-9313-2ff0debe5d2e None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:23:32.823758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed1dd1-a15d-4a04-b43c-59ff85b8e77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:23:32.824343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1dd1-a15d-4a04-b43c-59ff85b8e77e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:23:32.824620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1dd1-a15d-4a04-b43c-59ff85b8e77e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:23:32.824888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1dd1-a15d-4a04-b43c-59ff85b8e77e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:23:32.825598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed1dd1-a15d-4a04-b43c-59ff85b8e77e None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=a2339c3d00f4498c989dc48bd1181447, user.id=b2b2ef9ce9a64502ab61e3f7e64cdb02) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:23:32.825904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed1dd1-a15d-4a04-b43c-59ff85b8e77e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:23:32.827846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed1dd1-a15d-4a04-b43c-59ff85b8e77e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:23:32.833315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 604/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:23:32 2022] GET /identity/v3/role_assignments?user.id=b2b2ef9ce9a64502ab61e3f7e64cdb02&scope.project.id=a2339c3d00f4498c989dc48bd1181447&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:23:42.678469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=67 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:23:42.830903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=47 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:28.573036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0634041-34e0-4a75-a879-3139b7403f00 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:28.573036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0634041-34e0-4a75-a879-3139b7403f00 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:28.573036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0634041-34e0-4a75-a879-3139b7403f00 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:28.573036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 597/1201] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:24:28.580395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33e7fb-b563-4de1-8323-42e462688623 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:28.581361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33e7fb-b563-4de1-8323-42e462688623 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:28.581657 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33e7fb-b563-4de1-8323-42e462688623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:28.605319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0f33e7fb-b563-4de1-8323-42e462688623 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:24:28.606784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0f33e7fb-b563-4de1-8323-42e462688623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:24:28.697109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 605/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:24:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:24:28.983472 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0634041-34e0-4a75-a879-3139b7403f00 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:29.141624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0634041-34e0-4a75-a879-3139b7403f00 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:29.200882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaeb18-2bd2-4e05-801b-683fb1cd7f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:29.201951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaeb18-2bd2-4e05-801b-683fb1cd7f42 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:29.202383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaeb18-2bd2-4e05-801b-683fb1cd7f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:29.202895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaeb18-2bd2-4e05-801b-683fb1cd7f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:29.218573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eaeb18-2bd2-4e05-801b-683fb1cd7f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:29.220271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eaeb18-2bd2-4e05-801b-683fb1cd7f42 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-11eaeb18-2bd2-4e05-801b-683fb1cd7f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:29.238903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:29.240421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:29.241431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:29.241431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:29.241431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:29.241431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 598/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:29.249442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33e7fb-b563-4de1-8323-42e462688623 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:29.405019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33e7fb-b563-4de1-8323-42e462688623 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:29.440167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:29.447047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2a768-cf08-4e3a-89a1-db282efba870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:29.447659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a768-cf08-4e3a-89a1-db282efba870 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:29.448161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a768-cf08-4e3a-89a1-db282efba870 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:29.448447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a768-cf08-4e3a-89a1-db282efba870 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:29.449166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2a768-cf08-4e3a-89a1-db282efba870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:29.449511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2a768-cf08-4e3a-89a1-db282efba870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:29.453668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2a768-cf08-4e3a-89a1-db282efba870 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:29.471104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 606/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:24:29.482512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaeb18-2bd2-4e05-801b-683fb1cd7f42 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:29.549836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:29.611974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaeb18-2bd2-4e05-801b-683fb1cd7f42 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:29.671203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2f1ed-4d67-4f55-a65d-23c2b4bb5c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:29.672188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2f1ed-4d67-4f55-a65d-23c2b4bb5c19 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:29.672469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2f1ed-4d67-4f55-a65d-23c2b4bb5c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:29.672747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2f1ed-4d67-4f55-a65d-23c2b4bb5c19 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:29.673462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2f1ed-4d67-4f55-a65d-23c2b4bb5c19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:29.675084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2f1ed-4d67-4f55-a65d-23c2b4bb5c19 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:29.714961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 599/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Oct 4 08:24:29 2022] POST /identity/v3/users => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:24:32.258625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb9a52-ff1c-43ea-b94a-4ef9e2af6ec8 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:32.260977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb9a52-ff1c-43ea-b94a-4ef9e2af6ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:32.260977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb9a52-ff1c-43ea-b94a-4ef9e2af6ec8 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:32.260977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 607/1206] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:24:32.266922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9256b70-4c30-4697-8347-929ce1779211 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:32.267412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9256b70-4c30-4697-8347-929ce1779211 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:32.269549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9256b70-4c30-4697-8347-929ce1779211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:32.287386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d9256b70-4c30-4697-8347-929ce1779211 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:24:32.288745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d9256b70-4c30-4697-8347-929ce1779211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:24:32.372827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 600/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:24:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:24:32.711864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb9a52-ff1c-43ea-b94a-4ef9e2af6ec8 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:32.843413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb9a52-ff1c-43ea-b94a-4ef9e2af6ec8 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:32.892310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ddf14-04bc-4eaa-a67f-5fb8f77ea899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:32.892996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ddf14-04bc-4eaa-a67f-5fb8f77ea899 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:32.893281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ddf14-04bc-4eaa-a67f-5fb8f77ea899 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:32.893553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ddf14-04bc-4eaa-a67f-5fb8f77ea899 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:32.909854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ddf14-04bc-4eaa-a67f-5fb8f77ea899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-691ddf14-04bc-4eaa-a67f-5fb8f77ea899 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:24:32.915074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:32.916087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:32.916980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 608/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:24:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:32.922880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9256b70-4c30-4697-8347-929ce1779211 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:32.970775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:33.048253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9256b70-4c30-4697-8347-929ce1779211 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:33.096591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65592c83-348b-4f0a-bae3-647929101e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:33.097241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65592c83-348b-4f0a-bae3-647929101e97 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:33.097496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65592c83-348b-4f0a-bae3-647929101e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:33.097799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65592c83-348b-4f0a-bae3-647929101e97 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:33.098444 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65592c83-348b-4f0a-bae3-647929101e97 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:33.098780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65592c83-348b-4f0a-bae3-647929101e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:33.100264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65592c83-348b-4f0a-bae3-647929101e97 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:33.109959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 601/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:24:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:24:33.115837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ddf14-04bc-4eaa-a67f-5fb8f77ea899 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:33.189463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:33.256082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ddf14-04bc-4eaa-a67f-5fb8f77ea899 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:33.296699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c01a0-5a51-4ff5-9d29-ed0cd7980ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:33.297785 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c01a0-5a51-4ff5-9d29-ed0cd7980ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:33.297977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c01a0-5a51-4ff5-9d29-ed0cd7980ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:33.298370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c01a0-5a51-4ff5-9d29-ed0cd7980ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:33.315065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c01a0-5a51-4ff5-9d29-ed0cd7980ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:33.316830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c01a0-5a51-4ff5-9d29-ed0cd7980ad1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-998c01a0-5a51-4ff5-9d29-ed0cd7980ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:33.335971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:33.337260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:33.339208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:33.339208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:33.339208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:33.342715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 609/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:24:33.345214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65592c83-348b-4f0a-bae3-647929101e97 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:33.475848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:33.481158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65592c83-348b-4f0a-bae3-647929101e97 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:33.518763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5974bc-7cfe-46fb-a336-432a4d72d6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:33.519290 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5974bc-7cfe-46fb-a336-432a4d72d6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:33.519592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5974bc-7cfe-46fb-a336-432a4d72d6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:33.519884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5974bc-7cfe-46fb-a336-432a4d72d6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:33.520644 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5974bc-7cfe-46fb-a336-432a4d72d6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:33.520952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5974bc-7cfe-46fb-a336-432a4d72d6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:33.522320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5974bc-7cfe-46fb-a336-432a4d72d6b7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:33.534775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 602/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:33.540207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c01a0-5a51-4ff5-9d29-ed0cd7980ad1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:33.652090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c01a0-5a51-4ff5-9d29-ed0cd7980ad1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:33.653676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:33.691832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feaa87-452a-465d-908b-5fbf60219c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:33.692441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feaa87-452a-465d-908b-5fbf60219c9c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:33.692895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feaa87-452a-465d-908b-5fbf60219c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:33.693186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feaa87-452a-465d-908b-5fbf60219c9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:33.703518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87feaa87-452a-465d-908b-5fbf60219c9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:33.704975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87feaa87-452a-465d-908b-5fbf60219c9c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-87feaa87-452a-465d-908b-5fbf60219c9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:24:33.717401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:33.718412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:33.719504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 610/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:33.724925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5974bc-7cfe-46fb-a336-432a4d72d6b7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:33.847141 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5974bc-7cfe-46fb-a336-432a4d72d6b7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:33.892709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb3837-c26e-476c-a60c-15ad5896647e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:33.893465 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb3837-c26e-476c-a60c-15ad5896647e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:33.893747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb3837-c26e-476c-a60c-15ad5896647e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:33.894022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb3837-c26e-476c-a60c-15ad5896647e None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:33.894788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb3837-c26e-476c-a60c-15ad5896647e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:33.895098 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb3837-c26e-476c-a60c-15ad5896647e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:33.896534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb3837-c26e-476c-a60c-15ad5896647e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:33.917666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 603/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Oct 4 08:24:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:24:33.924431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feaa87-452a-465d-908b-5fbf60219c9c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:34.048534 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feaa87-452a-465d-908b-5fbf60219c9c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:34.096895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ddec6-b59d-4004-a74b-284f28eadd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:34.097634 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddec6-b59d-4004-a74b-284f28eadd8a None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:34.097865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddec6-b59d-4004-a74b-284f28eadd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:34.098142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddec6-b59d-4004-a74b-284f28eadd8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:34.130151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:34.188309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ddec6-b59d-4004-a74b-284f28eadd8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:34.190116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ddec6-b59d-4004-a74b-284f28eadd8a None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:34.309330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 611/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:24:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:24:34.315401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb3837-c26e-476c-a60c-15ad5896647e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:34.340152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:34.454831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb3837-c26e-476c-a60c-15ad5896647e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:34.499663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b333f-7015-404b-a622-788e8ec018fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:34.500309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b333f-7015-404b-a622-788e8ec018fa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:34.500590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b333f-7015-404b-a622-788e8ec018fa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:34.500861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b333f-7015-404b-a622-788e8ec018fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:34.514400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b333f-7015-404b-a622-788e8ec018fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:34.516112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b333f-7015-404b-a622-788e8ec018fa None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ca7b333f-7015-404b-a622-788e8ec018fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:34.532478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:34.533853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:34.534958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:34.534958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:34.534958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:34.534958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 604/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:34.539452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ddec6-b59d-4004-a74b-284f28eadd8a None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:34.602215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:34.643921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ddec6-b59d-4004-a74b-284f28eadd8a None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:34.680433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e5da-1b32-46f7-acc0-9b44d4f824cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:34.681044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e5da-1b32-46f7-acc0-9b44d4f824cf None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:34.681323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e5da-1b32-46f7-acc0-9b44d4f824cf None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:34.681676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e5da-1b32-46f7-acc0-9b44d4f824cf None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:34.682728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169e5da-1b32-46f7-acc0-9b44d4f824cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:34.683087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169e5da-1b32-46f7-acc0-9b44d4f824cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:34.684526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169e5da-1b32-46f7-acc0-9b44d4f824cf None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:34.695618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 612/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:34.701626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b333f-7015-404b-a622-788e8ec018fa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:34.798146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:34.839296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b333f-7015-404b-a622-788e8ec018fa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:34.876064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca64fa-62b5-4a85-bd35-f1e24175ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:34.876668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca64fa-62b5-4a85-bd35-f1e24175ae9d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:34.876987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca64fa-62b5-4a85-bd35-f1e24175ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:34.877232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca64fa-62b5-4a85-bd35-f1e24175ae9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:34.884218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca64fa-62b5-4a85-bd35-f1e24175ae9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:34.885682 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca64fa-62b5-4a85-bd35-f1e24175ae9d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e5ca64fa-62b5-4a85-bd35-f1e24175ae9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:24:34.897917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:34.898982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:34.899918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:24:34.899918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:24:34.899918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:24:34.899918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:24:34.899918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:24:34.899918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:24:34.899918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:34.899918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:34.899918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 605/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:34.905832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e5da-1b32-46f7-acc0-9b44d4f824cf None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:35.011575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e5da-1b32-46f7-acc0-9b44d4f824cf None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:35.038396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:35.054931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f1ef-3875-40de-9e9d-2faa6fdc5266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:35.055468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f1ef-3875-40de-9e9d-2faa6fdc5266 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:35.055748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f1ef-3875-40de-9e9d-2faa6fdc5266 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:35.056019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f1ef-3875-40de-9e9d-2faa6fdc5266 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:35.056780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22f1ef-3875-40de-9e9d-2faa6fdc5266 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:35.057125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22f1ef-3875-40de-9e9d-2faa6fdc5266 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:35.059099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22f1ef-3875-40de-9e9d-2faa6fdc5266 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:35.080621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 613/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:35.081965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca64fa-62b5-4a85-bd35-f1e24175ae9d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:35.200816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca64fa-62b5-4a85-bd35-f1e24175ae9d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:35.235191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:35.241248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a025a-8b1c-427c-9677-9af88381b45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:35.241855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a025a-8b1c-427c-9677-9af88381b45a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:35.242139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a025a-8b1c-427c-9677-9af88381b45a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:35.242412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a025a-8b1c-427c-9677-9af88381b45a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:35.243180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a025a-8b1c-427c-9677-9af88381b45a None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=6a4030325cf0481ab634e253cfed9c77) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:35.243479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a025a-8b1c-427c-9677-9af88381b45a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:35.245385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a025a-8b1c-427c-9677-9af88381b45a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:35.259603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 606/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:24:35 2022] GET /identity/v3/role_assignments?user.id=6a4030325cf0481ab634e253cfed9c77&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:37.634368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d8036-e4ee-4c1f-b95d-550dab3caa29 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:37.634992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d8036-e4ee-4c1f-b95d-550dab3caa29 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:37.634992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d8036-e4ee-4c1f-b95d-550dab3caa29 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:37.637147 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 614/1220] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:24:37.643933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b00d0-4a56-4ea0-993c-a4e76eeca59b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:37.644458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b00d0-4a56-4ea0-993c-a4e76eeca59b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:37.644458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b00d0-4a56-4ea0-993c-a4e76eeca59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:37.668700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-998b00d0-4a56-4ea0-993c-a4e76eeca59b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:24:37.669895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-998b00d0-4a56-4ea0-993c-a4e76eeca59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:24:37.757065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 607/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:24:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:24:38.093810 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d8036-e4ee-4c1f-b95d-550dab3caa29 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:38.223610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d8036-e4ee-4c1f-b95d-550dab3caa29 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:38.261171 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9d4c8-ae33-4c00-9688-ad74b5f37354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:38.261958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d4c8-ae33-4c00-9688-ad74b5f37354 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:38.262236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d4c8-ae33-4c00-9688-ad74b5f37354 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:38.262502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d4c8-ae33-4c00-9688-ad74b5f37354 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:38.272555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9d4c8-ae33-4c00-9688-ad74b5f37354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-43a9d4c8-ae33-4c00-9688-ad74b5f37354 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:24:38.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:38.279996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:38.281114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 615/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:24:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:38.286955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b00d0-4a56-4ea0-993c-a4e76eeca59b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:38.414527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b00d0-4a56-4ea0-993c-a4e76eeca59b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:38.444989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:38.458231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ed2e9-3436-41a5-a76f-fa6112a1899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:38.458876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ed2e9-3436-41a5-a76f-fa6112a1899b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:38.459190 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ed2e9-3436-41a5-a76f-fa6112a1899b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:38.459460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ed2e9-3436-41a5-a76f-fa6112a1899b None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:38.460344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ed2e9-3436-41a5-a76f-fa6112a1899b None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:38.460690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ed2e9-3436-41a5-a76f-fa6112a1899b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:38.462293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ed2e9-3436-41a5-a76f-fa6112a1899b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:38.472771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 608/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:24:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:38.479952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9d4c8-ae33-4c00-9688-ad74b5f37354 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:38.532670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:38.596946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9d4c8-ae33-4c00-9688-ad74b5f37354 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:38.637204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d342-4e14-4d8c-931d-2451002a4efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:38.637901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d342-4e14-4d8c-931d-2451002a4efc None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:38.638156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d342-4e14-4d8c-931d-2451002a4efc None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:38.638431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d342-4e14-4d8c-931d-2451002a4efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:38.649279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356d342-4e14-4d8c-931d-2451002a4efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:38.651093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356d342-4e14-4d8c-931d-2451002a4efc None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-8356d342-4e14-4d8c-931d-2451002a4efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:38.666293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:38.667379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:38.668328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:38.668328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:38.668328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:38.668328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 616/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:38.673623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ed2e9-3436-41a5-a76f-fa6112a1899b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:38.784551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ed2e9-3436-41a5-a76f-fa6112a1899b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:38.818691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631857cb-418a-419a-9bee-e93e9c747895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:38.819310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631857cb-418a-419a-9bee-e93e9c747895 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:38.819589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631857cb-418a-419a-9bee-e93e9c747895 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:38.819857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631857cb-418a-419a-9bee-e93e9c747895 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:38.820483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631857cb-418a-419a-9bee-e93e9c747895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:38.820784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631857cb-418a-419a-9bee-e93e9c747895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:38.822163 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631857cb-418a-419a-9bee-e93e9c747895 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:38.833321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 609/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:38.839396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d342-4e14-4d8c-931d-2451002a4efc None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:38.946315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:38.955374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d342-4e14-4d8c-931d-2451002a4efc None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:38.992787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042754c9-9b0d-48c5-ae95-3c61c0726d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:38.993611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042754c9-9b0d-48c5-ae95-3c61c0726d6c None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:38.994030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042754c9-9b0d-48c5-ae95-3c61c0726d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:38.994653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042754c9-9b0d-48c5-ae95-3c61c0726d6c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:39.003396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042754c9-9b0d-48c5-ae95-3c61c0726d6c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:39.005006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042754c9-9b0d-48c5-ae95-3c61c0726d6c None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-042754c9-9b0d-48c5-ae95-3c61c0726d6c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:24:39.018004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:39.019206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:39.020205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 617/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:39.026167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631857cb-418a-419a-9bee-e93e9c747895 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:39.078778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:39.142527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631857cb-418a-419a-9bee-e93e9c747895 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:39.183340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069156d-5b59-4630-a0be-8ecebbad0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:39.184020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069156d-5b59-4630-a0be-8ecebbad0031 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:39.184403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069156d-5b59-4630-a0be-8ecebbad0031 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:39.184714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069156d-5b59-4630-a0be-8ecebbad0031 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:39.185486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069156d-5b59-4630-a0be-8ecebbad0031 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:39.185885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069156d-5b59-4630-a0be-8ecebbad0031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:39.187595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069156d-5b59-4630-a0be-8ecebbad0031 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:39.206170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 610/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Oct 4 08:24:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:39.212014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042754c9-9b0d-48c5-ae95-3c61c0726d6c None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:39.319891 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042754c9-9b0d-48c5-ae95-3c61c0726d6c None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:39.357152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb047f0-ef21-4689-8bff-2db167646896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:39.357910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb047f0-ef21-4689-8bff-2db167646896 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:39.358113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb047f0-ef21-4689-8bff-2db167646896 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:39.358513 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb047f0-ef21-4689-8bff-2db167646896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:39.371549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb047f0-ef21-4689-8bff-2db167646896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:39.373006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb047f0-ef21-4689-8bff-2db167646896 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-fcb047f0-ef21-4689-8bff-2db167646896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:39.387328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:39.388668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:39.389868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:39.389868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:39.389868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:39.389868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 618/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:39.394363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069156d-5b59-4630-a0be-8ecebbad0031 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:39.507820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069156d-5b59-4630-a0be-8ecebbad0031 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:39.510176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:39.546520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b78a2e-4bf1-46d0-bd2a-2bb035d69419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:39.547378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78a2e-4bf1-46d0-bd2a-2bb035d69419 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:39.547709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78a2e-4bf1-46d0-bd2a-2bb035d69419 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:39.547915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78a2e-4bf1-46d0-bd2a-2bb035d69419 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:39.548559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b78a2e-4bf1-46d0-bd2a-2bb035d69419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:39.548886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b78a2e-4bf1-46d0-bd2a-2bb035d69419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:39.550238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b78a2e-4bf1-46d0-bd2a-2bb035d69419 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:39.562468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 611/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:24:39.568552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb047f0-ef21-4689-8bff-2db167646896 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:39.579102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:39.686901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb047f0-ef21-4689-8bff-2db167646896 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:39.724481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb50e4-a09a-46ce-9ad9-26ed27862766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:39.725039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb50e4-a09a-46ce-9ad9-26ed27862766 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:39.725321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb50e4-a09a-46ce-9ad9-26ed27862766 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:39.725592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb50e4-a09a-46ce-9ad9-26ed27862766 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:39.732872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb50e4-a09a-46ce-9ad9-26ed27862766 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:39.734313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb50e4-a09a-46ce-9ad9-26ed27862766 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-ccdb50e4-a09a-46ce-9ad9-26ed27862766 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:24:39.746696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:39.747798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:39.748718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:24:39.748718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:24:39.748718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:24:39.748718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:24:39.748718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:24:39.748718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:24:39.748718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:39.748718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:39.748718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 619/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:39.755343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b78a2e-4bf1-46d0-bd2a-2bb035d69419 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:39.865240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b78a2e-4bf1-46d0-bd2a-2bb035d69419 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:39.900045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744237b0-8433-4d7d-8ce2-3d0cf66d67a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:39.901369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744237b0-8433-4d7d-8ce2-3d0cf66d67a3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:39.901746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744237b0-8433-4d7d-8ce2-3d0cf66d67a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:39.902093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744237b0-8433-4d7d-8ce2-3d0cf66d67a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:39.902819 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744237b0-8433-4d7d-8ce2-3d0cf66d67a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:39.903129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744237b0-8433-4d7d-8ce2-3d0cf66d67a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:39.904581 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744237b0-8433-4d7d-8ce2-3d0cf66d67a3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:39.920410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 612/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:39.927075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb50e4-a09a-46ce-9ad9-26ed27862766 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:40.007503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:40.050847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb50e4-a09a-46ce-9ad9-26ed27862766 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:40.089750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb2e3c-5d1d-4d2c-ae68-3d80afbaf98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:40.090562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb2e3c-5d1d-4d2c-ae68-3d80afbaf98b None admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:40.090847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb2e3c-5d1d-4d2c-ae68-3d80afbaf98b None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:40.091252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb2e3c-5d1d-4d2c-ae68-3d80afbaf98b None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/6a4030325cf0481ab634e253cfed9c77/roles/d228c647a46049f6899439970c288c22` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:40.108045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb2e3c-5d1d-4d2c-ae68-3d80afbaf98b None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=6a4030325cf0481ab634e253cfed9c77, role_id=d228c647a46049f6899439970c288c22)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:40.109819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb2e3c-5d1d-4d2c-ae68-3d80afbaf98b None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:40.123720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 620/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:24:39 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/6a4030325cf0481ab634e253cfed9c77/roles/d228c647a46049f6899439970c288c22 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:24:42.465612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35425d-a2d5-49d7-aa0e-2ee5b03e7c25 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:42.466156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35425d-a2d5-49d7-aa0e-2ee5b03e7c25 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:42.466156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35425d-a2d5-49d7-aa0e-2ee5b03e7c25 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:42.468735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 613/1233] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:24:42.473554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aff30-2b39-4008-89bc-9912a998043e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:42.474054 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aff30-2b39-4008-89bc-9912a998043e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:42.474179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aff30-2b39-4008-89bc-9912a998043e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:42.495229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-017aff30-2b39-4008-89bc-9912a998043e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:24:42.496454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-017aff30-2b39-4008-89bc-9912a998043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:24:42.572511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 621/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:24:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:24:42.848771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35425d-a2d5-49d7-aa0e-2ee5b03e7c25 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:42.874568 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:42.962420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35425d-a2d5-49d7-aa0e-2ee5b03e7c25 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:43.004048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c6f83-b744-4487-a0fc-9d1d1dae1ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:43.004743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c6f83-b744-4487-a0fc-9d1d1dae1ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:43.005050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c6f83-b744-4487-a0fc-9d1d1dae1ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:43.005334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c6f83-b744-4487-a0fc-9d1d1dae1ac5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:43.017280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c6f83-b744-4487-a0fc-9d1d1dae1ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-475c6f83-b744-4487-a0fc-9d1d1dae1ac5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:24:43.022450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:43.023838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:43.024786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 614/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Oct 4 08:24:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:43.029864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017aff30-2b39-4008-89bc-9912a998043e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:43.079845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:43.137909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017aff30-2b39-4008-89bc-9912a998043e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:43.176245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece3005-8ad8-44e8-aed2-ee06f1796a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:43.176941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece3005-8ad8-44e8-aed2-ee06f1796a7f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:43.177105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece3005-8ad8-44e8-aed2-ee06f1796a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:43.177402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece3005-8ad8-44e8-aed2-ee06f1796a7f None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:43.178206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece3005-8ad8-44e8-aed2-ee06f1796a7f None admin] RBAC: Adding query filter params (name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:43.178470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece3005-8ad8-44e8-aed2-ee06f1796a7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:43.179873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece3005-8ad8-44e8-aed2-ee06f1796a7f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:43.191780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 622/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Oct 4 08:24:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:24:43.199393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c6f83-b744-4487-a0fc-9d1d1dae1ac5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:43.303351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:43.323715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c6f83-b744-4487-a0fc-9d1d1dae1ac5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:43.373193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d34a1a-8dd2-4620-b7e3-0edb5ab77c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:43.374106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d34a1a-8dd2-4620-b7e3-0edb5ab77c2f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:43.374331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d34a1a-8dd2-4620-b7e3-0edb5ab77c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:43.374601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d34a1a-8dd2-4620-b7e3-0edb5ab77c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:43.387017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d34a1a-8dd2-4620-b7e3-0edb5ab77c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:43.389016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d34a1a-8dd2-4620-b7e3-0edb5ab77c2f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-06d34a1a-8dd2-4620-b7e3-0edb5ab77c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:43.406774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:43.407940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:43.408974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:43.408974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:43.408974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:43.408974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 615/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:43.415668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece3005-8ad8-44e8-aed2-ee06f1796a7f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:43.532255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece3005-8ad8-44e8-aed2-ee06f1796a7f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:43.542764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:43.573782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc1b0c-56e8-4a8f-8eec-6e4d5a597768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:43.574630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1b0c-56e8-4a8f-8eec-6e4d5a597768 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:43.574919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1b0c-56e8-4a8f-8eec-6e4d5a597768 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:43.575300 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1b0c-56e8-4a8f-8eec-6e4d5a597768 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:43.575998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc1b0c-56e8-4a8f-8eec-6e4d5a597768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:43.576433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc1b0c-56e8-4a8f-8eec-6e4d5a597768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:43.578294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc1b0c-56e8-4a8f-8eec-6e4d5a597768 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:43.592882 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 623/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:43.600064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d34a1a-8dd2-4620-b7e3-0edb5ab77c2f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:43.713738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d34a1a-8dd2-4620-b7e3-0edb5ab77c2f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:43.751931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9bd51-0226-410e-aaf7-b904e7aab72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:43.752629 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9bd51-0226-410e-aaf7-b904e7aab72d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:43.752896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9bd51-0226-410e-aaf7-b904e7aab72d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:43.753167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9bd51-0226-410e-aaf7-b904e7aab72d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:43.756869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:43.763931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9bd51-0226-410e-aaf7-b904e7aab72d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:43.765845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9bd51-0226-410e-aaf7-b904e7aab72d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-29d9bd51-0226-410e-aaf7-b904e7aab72d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:24:43.786964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:43.788688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:43.789647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 616/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:43.794457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc1b0c-56e8-4a8f-8eec-6e4d5a597768 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:43.906606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc1b0c-56e8-4a8f-8eec-6e4d5a597768 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:43.943660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ec936-8a93-49dc-8774-7737416296d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:43.944365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ec936-8a93-49dc-8774-7737416296d1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:43.944760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ec936-8a93-49dc-8774-7737416296d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:43.945049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ec936-8a93-49dc-8774-7737416296d1 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:43.945921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ec936-8a93-49dc-8774-7737416296d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:43.946227 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ec936-8a93-49dc-8774-7737416296d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:43.948579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ec936-8a93-49dc-8774-7737416296d1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:43.969509 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 624/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Oct 4 08:24:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:43.975960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9bd51-0226-410e-aaf7-b904e7aab72d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:44.097804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9bd51-0226-410e-aaf7-b904e7aab72d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:44.138718 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e668c-4fec-4de1-8262-511a65dd2daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:44.139386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e668c-4fec-4de1-8262-511a65dd2daa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:44.139664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e668c-4fec-4de1-8262-511a65dd2daa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:44.139934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e668c-4fec-4de1-8262-511a65dd2daa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:44.223015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:44.232076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e668c-4fec-4de1-8262-511a65dd2daa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:44.234733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e668c-4fec-4de1-8262-511a65dd2daa None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:44.352144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 617/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:24:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:24:44.358530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ec936-8a93-49dc-8774-7737416296d1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:44.389958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:44.482471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ec936-8a93-49dc-8774-7737416296d1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:44.521556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f00c0-3303-4ff9-aef2-dc217d2c8c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:44.522244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f00c0-3303-4ff9-aef2-dc217d2c8c82 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:44.522567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f00c0-3303-4ff9-aef2-dc217d2c8c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:44.522867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f00c0-3303-4ff9-aef2-dc217d2c8c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:44.535031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f00c0-3303-4ff9-aef2-dc217d2c8c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:44.536619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f00c0-3303-4ff9-aef2-dc217d2c8c82 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-ef6f00c0-3303-4ff9-aef2-dc217d2c8c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:44.554225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:44.555360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:44.556636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:44.556636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:44.556636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:44.556636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 625/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:44.561505 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e668c-4fec-4de1-8262-511a65dd2daa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:44.670194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:44.676509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e668c-4fec-4de1-8262-511a65dd2daa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:44.715753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40961-d461-49f8-bded-6223b646f845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:44.716497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40961-d461-49f8-bded-6223b646f845 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:44.716863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40961-d461-49f8-bded-6223b646f845 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:44.717257 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40961-d461-49f8-bded-6223b646f845 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:44.718049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f40961-d461-49f8-bded-6223b646f845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:44.718355 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f40961-d461-49f8-bded-6223b646f845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:44.719759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f40961-d461-49f8-bded-6223b646f845 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:44.733117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 618/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:44.738956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f00c0-3303-4ff9-aef2-dc217d2c8c82 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:44.829679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:44.853161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f00c0-3303-4ff9-aef2-dc217d2c8c82 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:44.894323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4e204-1ace-43b1-a30e-afdd385ceab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:44.895182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4e204-1ace-43b1-a30e-afdd385ceab3 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:44.895993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4e204-1ace-43b1-a30e-afdd385ceab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:44.896277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4e204-1ace-43b1-a30e-afdd385ceab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:44.907977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4e204-1ace-43b1-a30e-afdd385ceab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:44.910843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4e204-1ace-43b1-a30e-afdd385ceab3 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-67b4e204-1ace-43b1-a30e-afdd385ceab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:24:44.926619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:44.927738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:44.928673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:24:44.928673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:24:44.928673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:24:44.928673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:24:44.928673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:24:44.928673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:24:44.928673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:44.928673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:44.933224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 626/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:44.934859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40961-d461-49f8-bded-6223b646f845 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:45.074913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40961-d461-49f8-bded-6223b646f845 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:45.112177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b25734-dc99-4d0e-8440-b6ddf05730b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:45.112870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b25734-dc99-4d0e-8440-b6ddf05730b3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:45.113197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b25734-dc99-4d0e-8440-b6ddf05730b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:45.113521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b25734-dc99-4d0e-8440-b6ddf05730b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:45.114220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b25734-dc99-4d0e-8440-b6ddf05730b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:45.114571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b25734-dc99-4d0e-8440-b6ddf05730b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:45.116115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b25734-dc99-4d0e-8440-b6ddf05730b3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:45.128917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 619/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:45.136379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4e204-1ace-43b1-a30e-afdd385ceab3 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:45.274351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4e204-1ace-43b1-a30e-afdd385ceab3 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:45.315860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b8ce7-b1c2-4d6a-bd2a-0cafc1a1d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:45.316523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b8ce7-b1c2-4d6a-bd2a-0cafc1a1d309 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:45.316931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b8ce7-b1c2-4d6a-bd2a-0cafc1a1d309 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:45.317278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b8ce7-b1c2-4d6a-bd2a-0cafc1a1d309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:45.318225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b8ce7-b1c2-4d6a-bd2a-0cafc1a1d309 None admin] RBAC: Adding query filter params (role.id=d228c647a46049f6899439970c288c22, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=6a4030325cf0481ab634e253cfed9c77) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:45.318739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b8ce7-b1c2-4d6a-bd2a-0cafc1a1d309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:45.320502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b8ce7-b1c2-4d6a-bd2a-0cafc1a1d309 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:45.329028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 627/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:24:45 2022] GET /identity/v3/role_assignments?user.id=6a4030325cf0481ab634e253cfed9c77&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=d228c647a46049f6899439970c288c22 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:47.824272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604d661-2c2d-4cb7-9e7f-556cf312e818 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:47.824803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604d661-2c2d-4cb7-9e7f-556cf312e818 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:47.824803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604d661-2c2d-4cb7-9e7f-556cf312e818 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:47.827789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 620/1247] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:24:47.833858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168900da-15ea-4130-a6dd-72efdf290be5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:47.834357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168900da-15ea-4130-a6dd-72efdf290be5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:47.834698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168900da-15ea-4130-a6dd-72efdf290be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:47.844328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:47.857792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-168900da-15ea-4130-a6dd-72efdf290be5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:24:47.859092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-168900da-15ea-4130-a6dd-72efdf290be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:24:47.931846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 628/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:24:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:24:48.246363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604d661-2c2d-4cb7-9e7f-556cf312e818 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:48.265974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:48.356065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604d661-2c2d-4cb7-9e7f-556cf312e818 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:48.392412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82766f-d2a2-404e-870a-451f97771b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:48.393053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82766f-d2a2-404e-870a-451f97771b34 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:48.393332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82766f-d2a2-404e-870a-451f97771b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:48.393601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82766f-d2a2-404e-870a-451f97771b34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:48.405262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82766f-d2a2-404e-870a-451f97771b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cc82766f-d2a2-404e-870a-451f97771b34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:24:48.410269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:48.411463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:48.412303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 621/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:48.418134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168900da-15ea-4130-a6dd-72efdf290be5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:48.531505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168900da-15ea-4130-a6dd-72efdf290be5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:48.564017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:48.569465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2641df-b8a2-41fe-a751-b412f79b3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:48.570072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2641df-b8a2-41fe-a751-b412f79b3888 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:48.570349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2641df-b8a2-41fe-a751-b412f79b3888 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:48.570616 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2641df-b8a2-41fe-a751-b412f79b3888 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:48.571310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2641df-b8a2-41fe-a751-b412f79b3888 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:48.571678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2641df-b8a2-41fe-a751-b412f79b3888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:48.573099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2641df-b8a2-41fe-a751-b412f79b3888 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:48.581517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 629/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:48.587537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82766f-d2a2-404e-870a-451f97771b34 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:48.667623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:48.691036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82766f-d2a2-404e-870a-451f97771b34 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:48.725145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777ca7c-d13c-48fc-9d59-f88dc43b79e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:48.725774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777ca7c-d13c-48fc-9d59-f88dc43b79e4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:48.726057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777ca7c-d13c-48fc-9d59-f88dc43b79e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:48.726335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777ca7c-d13c-48fc-9d59-f88dc43b79e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:48.737544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777ca7c-d13c-48fc-9d59-f88dc43b79e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:48.739026 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777ca7c-d13c-48fc-9d59-f88dc43b79e4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8777ca7c-d13c-48fc-9d59-f88dc43b79e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:48.754809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:48.755907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:48.756846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:48.756846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:48.756846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:48.756846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 622/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:48.761965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2641df-b8a2-41fe-a751-b412f79b3888 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:48.874218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2641df-b8a2-41fe-a751-b412f79b3888 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:48.910457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2909a2-b347-4141-8640-83f130746afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:48.911081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2909a2-b347-4141-8640-83f130746afb None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:48.911360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2909a2-b347-4141-8640-83f130746afb None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:48.911632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2909a2-b347-4141-8640-83f130746afb None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:48.912271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2909a2-b347-4141-8640-83f130746afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:48.912573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2909a2-b347-4141-8640-83f130746afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:48.913930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2909a2-b347-4141-8640-83f130746afb None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:48.926623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 630/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:48.932390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777ca7c-d13c-48fc-9d59-f88dc43b79e4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:49.028657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777ca7c-d13c-48fc-9d59-f88dc43b79e4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:49.054057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:49.062007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f6fd1-770d-4c51-9caa-8f4be1a7e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:49.062615 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f6fd1-770d-4c51-9caa-8f4be1a7e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:49.062923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f6fd1-770d-4c51-9caa-8f4be1a7e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:49.063192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f6fd1-770d-4c51-9caa-8f4be1a7e8b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:49.070361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f6fd1-770d-4c51-9caa-8f4be1a7e8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:49.072338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f6fd1-770d-4c51-9caa-8f4be1a7e8b6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ab2f6fd1-770d-4c51-9caa-8f4be1a7e8b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:24:49.083278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:49.084374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:49.085321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 623/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:49.090844 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2909a2-b347-4141-8640-83f130746afb None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:49.143575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:49.192504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2909a2-b347-4141-8640-83f130746afb None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:49.225144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28a7e4-030d-448b-a36e-457d7a4e0fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:49.225741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a7e4-030d-448b-a36e-457d7a4e0fee None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:49.226019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a7e4-030d-448b-a36e-457d7a4e0fee None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:49.226290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a7e4-030d-448b-a36e-457d7a4e0fee None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:49.227039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28a7e4-030d-448b-a36e-457d7a4e0fee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:49.227345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28a7e4-030d-448b-a36e-457d7a4e0fee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:49.229601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28a7e4-030d-448b-a36e-457d7a4e0fee None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:49.245737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 631/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Oct 4 08:24:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:49.251571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f6fd1-770d-4c51-9caa-8f4be1a7e8b6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:49.350459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f6fd1-770d-4c51-9caa-8f4be1a7e8b6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:49.382563 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6796f4-00a2-4b95-8f90-76a3141f5e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:49.383176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6796f4-00a2-4b95-8f90-76a3141f5e23 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:49.383456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6796f4-00a2-4b95-8f90-76a3141f5e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:49.383726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6796f4-00a2-4b95-8f90-76a3141f5e23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:49.437474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:49.450145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6796f4-00a2-4b95-8f90-76a3141f5e23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:49.451652 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6796f4-00a2-4b95-8f90-76a3141f5e23 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:49.548615 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 624/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:24:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:24:49.554356 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28a7e4-030d-448b-a36e-457d7a4e0fee None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:49.647723 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28a7e4-030d-448b-a36e-457d7a4e0fee None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:49.660482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:49.680508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe13a2-f20c-43d7-8bd6-cc2aedf42173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:49.681878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe13a2-f20c-43d7-8bd6-cc2aedf42173 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:49.682159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe13a2-f20c-43d7-8bd6-cc2aedf42173 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:49.682424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe13a2-f20c-43d7-8bd6-cc2aedf42173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:49.691929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe13a2-f20c-43d7-8bd6-cc2aedf42173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:49.693297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe13a2-f20c-43d7-8bd6-cc2aedf42173 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-2abe13a2-f20c-43d7-8bd6-cc2aedf42173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:49.707886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:49.708979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:49.709897 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:49.709897 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:49.709897 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:49.709897 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 632/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:49.714560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6796f4-00a2-4b95-8f90-76a3141f5e23 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:49.797144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:49.809322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6796f4-00a2-4b95-8f90-76a3141f5e23 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:49.841819 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2238-523e-4425-ae65-f7e05461bd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:49.842405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2238-523e-4425-ae65-f7e05461bd8b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:49.842693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2238-523e-4425-ae65-f7e05461bd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:49.842968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2238-523e-4425-ae65-f7e05461bd8b None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:49.843592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f2238-523e-4425-ae65-f7e05461bd8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:49.843892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f2238-523e-4425-ae65-f7e05461bd8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:49.845241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f2238-523e-4425-ae65-f7e05461bd8b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:49.855898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 625/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:49.861412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe13a2-f20c-43d7-8bd6-cc2aedf42173 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:49.959197 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe13a2-f20c-43d7-8bd6-cc2aedf42173 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:49.990332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c3606-4b6f-4f9c-8218-0842840ed2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:49.990968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c3606-4b6f-4f9c-8218-0842840ed2bd None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:49.991249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c3606-4b6f-4f9c-8218-0842840ed2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:49.991517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c3606-4b6f-4f9c-8218-0842840ed2bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:49.998295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c3606-4b6f-4f9c-8218-0842840ed2bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:49.999757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c3606-4b6f-4f9c-8218-0842840ed2bd None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-cc4c3606-4b6f-4f9c-8218-0842840ed2bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:24:50.011404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:50.012318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:50.013265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:24:50.013265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:24:50.013265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:24:50.013265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:24:50.013265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:24:50.013265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:24:50.013265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:50.013265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:50.013265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 633/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:24:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:50.018312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2238-523e-4425-ae65-f7e05461bd8b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:50.113957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2238-523e-4425-ae65-f7e05461bd8b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:50.146293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f77a1-90f7-4fc5-999b-8d1bf8599639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:50.146917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f77a1-90f7-4fc5-999b-8d1bf8599639 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:50.147191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f77a1-90f7-4fc5-999b-8d1bf8599639 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:50.147461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f77a1-90f7-4fc5-999b-8d1bf8599639 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:50.148133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f77a1-90f7-4fc5-999b-8d1bf8599639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:50.148436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f77a1-90f7-4fc5-999b-8d1bf8599639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:50.149966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f77a1-90f7-4fc5-999b-8d1bf8599639 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:50.161896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 626/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:50.168855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c3606-4b6f-4f9c-8218-0842840ed2bd None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:50.195570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:50.271163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c3606-4b6f-4f9c-8218-0842840ed2bd None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:50.303258 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254f5df-fe17-4c63-9c50-5918f9b5c6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:50.303851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f5df-fe17-4c63-9c50-5918f9b5c6ed None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:50.304129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f5df-fe17-4c63-9c50-5918f9b5c6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:50.304398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f5df-fe17-4c63-9c50-5918f9b5c6ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:50.305116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254f5df-fe17-4c63-9c50-5918f9b5c6ed None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=6a4030325cf0481ab634e253cfed9c77) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:50.305425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254f5df-fe17-4c63-9c50-5918f9b5c6ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:50.307648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254f5df-fe17-4c63-9c50-5918f9b5c6ed None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:50.312814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 634/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:24:50 2022] GET /identity/v3/role_assignments?user.id=6a4030325cf0481ab634e253cfed9c77&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:52.404426 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392e7ed-a26a-4c85-afaa-fec642608f3a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:52.404961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392e7ed-a26a-4c85-afaa-fec642608f3a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:52.404961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392e7ed-a26a-4c85-afaa-fec642608f3a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:52.406301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 627/1261] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:24:52.411486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a81d-04a9-4c23-9100-508c90b51c51 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:52.411895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a81d-04a9-4c23-9100-508c90b51c51 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:52.412031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a81d-04a9-4c23-9100-508c90b51c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:52.432005 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2344a81d-04a9-4c23-9100-508c90b51c51 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:24:52.433174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2344a81d-04a9-4c23-9100-508c90b51c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:24:52.498687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 635/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:24:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:24:52.766281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392e7ed-a26a-4c85-afaa-fec642608f3a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:52.777743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:52.866101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392e7ed-a26a-4c85-afaa-fec642608f3a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:52.898806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860d165-3a67-42d4-848c-7ff77dd51d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:52.900105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d165-3a67-42d4-848c-7ff77dd51d76 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:52.900384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d165-3a67-42d4-848c-7ff77dd51d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:52.900652 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d165-3a67-42d4-848c-7ff77dd51d76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:52.910368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860d165-3a67-42d4-848c-7ff77dd51d76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c860d165-3a67-42d4-848c-7ff77dd51d76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:24:52.915764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:52.916939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:52.918169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 628/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:24:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:52.923241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344a81d-04a9-4c23-9100-508c90b51c51 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:52.941350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:53.018731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344a81d-04a9-4c23-9100-508c90b51c51 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:53.051899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497a1f0-a80e-4fbf-a708-e3f0071da213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:53.052488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497a1f0-a80e-4fbf-a708-e3f0071da213 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:53.052769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497a1f0-a80e-4fbf-a708-e3f0071da213 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:53.053036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497a1f0-a80e-4fbf-a708-e3f0071da213 None admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:53.053677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497a1f0-a80e-4fbf-a708-e3f0071da213 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:53.053976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497a1f0-a80e-4fbf-a708-e3f0071da213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:53.055349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497a1f0-a80e-4fbf-a708-e3f0071da213 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:53.063059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 636/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:24:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:53.068784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860d165-3a67-42d4-848c-7ff77dd51d76 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:53.133500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:53.168717 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860d165-3a67-42d4-848c-7ff77dd51d76 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:53.205573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec3628-1cca-4716-a9a3-b2d76d57f0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:53.206201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec3628-1cca-4716-a9a3-b2d76d57f0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:53.206480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec3628-1cca-4716-a9a3-b2d76d57f0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:53.206899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec3628-1cca-4716-a9a3-b2d76d57f0a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:53.218482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec3628-1cca-4716-a9a3-b2d76d57f0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:53.220006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec3628-1cca-4716-a9a3-b2d76d57f0a3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-89ec3628-1cca-4716-a9a3-b2d76d57f0a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:53.234422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:53.235481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:53.236389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:53.236389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:53.236389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:53.236389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 629/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:53.241354 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497a1f0-a80e-4fbf-a708-e3f0071da213 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:53.319013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:53.338648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497a1f0-a80e-4fbf-a708-e3f0071da213 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:53.370962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ee7b8-e097-4c0a-9b25-f6de922ef386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:53.371552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ee7b8-e097-4c0a-9b25-f6de922ef386 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:53.371834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ee7b8-e097-4c0a-9b25-f6de922ef386 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:53.372101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ee7b8-e097-4c0a-9b25-f6de922ef386 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:53.372732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ee7b8-e097-4c0a-9b25-f6de922ef386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:53.373032 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ee7b8-e097-4c0a-9b25-f6de922ef386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:53.374374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ee7b8-e097-4c0a-9b25-f6de922ef386 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:53.386057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 637/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:53.391589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec3628-1cca-4716-a9a3-b2d76d57f0a3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:53.488570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec3628-1cca-4716-a9a3-b2d76d57f0a3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:53.507486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:53.521709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ab97f-15bf-456a-9831-bd3fbb8bd2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:53.522327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ab97f-15bf-456a-9831-bd3fbb8bd2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:53.522615 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ab97f-15bf-456a-9831-bd3fbb8bd2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:53.522918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ab97f-15bf-456a-9831-bd3fbb8bd2a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:53.530104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ab97f-15bf-456a-9831-bd3fbb8bd2a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:53.531566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ab97f-15bf-456a-9831-bd3fbb8bd2a5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-bd8ab97f-15bf-456a-9831-bd3fbb8bd2a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:24:53.542385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:53.543531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:53.544489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 630/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:53.549470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ee7b8-e097-4c0a-9b25-f6de922ef386 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:53.645408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ee7b8-e097-4c0a-9b25-f6de922ef386 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:53.677392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063973e-eef5-4a34-8489-7dafcfd65277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:53.677985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063973e-eef5-4a34-8489-7dafcfd65277 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:53.678263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063973e-eef5-4a34-8489-7dafcfd65277 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:53.678533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063973e-eef5-4a34-8489-7dafcfd65277 None admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:53.679280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063973e-eef5-4a34-8489-7dafcfd65277 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:53.679586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063973e-eef5-4a34-8489-7dafcfd65277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:53.682071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063973e-eef5-4a34-8489-7dafcfd65277 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:53.690544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:53.699788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 638/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Oct 4 08:24:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:53.705556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ab97f-15bf-456a-9831-bd3fbb8bd2a5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:53.803965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ab97f-15bf-456a-9831-bd3fbb8bd2a5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:53.837602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371690e4-b6a5-4a13-99fb-de1255870dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:53.838222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371690e4-b6a5-4a13-99fb-de1255870dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:53.838506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371690e4-b6a5-4a13-99fb-de1255870dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:53.838807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371690e4-b6a5-4a13-99fb-de1255870dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:53.848855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371690e4-b6a5-4a13-99fb-de1255870dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:53.850290 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371690e4-b6a5-4a13-99fb-de1255870dd0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-371690e4-b6a5-4a13-99fb-de1255870dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:53.864948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:53.866066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:53.867366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:53.867366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:53.867366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:53.867366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 631/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:53.872518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063973e-eef5-4a34-8489-7dafcfd65277 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:53.966019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063973e-eef5-4a34-8489-7dafcfd65277 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:53.998443 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16a02-7b7e-4ab6-8350-adea16685522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:53.999058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16a02-7b7e-4ab6-8350-adea16685522 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:53.999334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16a02-7b7e-4ab6-8350-adea16685522 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:53.999599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16a02-7b7e-4ab6-8350-adea16685522 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:54.000222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d16a02-7b7e-4ab6-8350-adea16685522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:54.000520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d16a02-7b7e-4ab6-8350-adea16685522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:54.001859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d16a02-7b7e-4ab6-8350-adea16685522 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:54.013055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 639/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:54.018795 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371690e4-b6a5-4a13-99fb-de1255870dd0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:54.051054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:54.117325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371690e4-b6a5-4a13-99fb-de1255870dd0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:54.152292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315db8e-c72e-4c4f-b18f-1dca832fc592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:54.152996 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315db8e-c72e-4c4f-b18f-1dca832fc592 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:54.153189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315db8e-c72e-4c4f-b18f-1dca832fc592 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:54.153510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315db8e-c72e-4c4f-b18f-1dca832fc592 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:54.160248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315db8e-c72e-4c4f-b18f-1dca832fc592 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:54.161691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315db8e-c72e-4c4f-b18f-1dca832fc592 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f315db8e-c72e-4c4f-b18f-1dca832fc592 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:24:54.173732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:54.174800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:54.175891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:24:54.175891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:24:54.175891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:24:54.175891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:24:54.175891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:24:54.175891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:24:54.175891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:54.175891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:54.175891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 632/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:24:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:54.181056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16a02-7b7e-4ab6-8350-adea16685522 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:54.237194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:54.276941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16a02-7b7e-4ab6-8350-adea16685522 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:54.309044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c17c05-056b-4f0d-9898-cef8af80d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:54.309635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17c05-056b-4f0d-9898-cef8af80d14e None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:54.309914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17c05-056b-4f0d-9898-cef8af80d14e None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:54.310187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17c05-056b-4f0d-9898-cef8af80d14e None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:54.310917 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c17c05-056b-4f0d-9898-cef8af80d14e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:54.311225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c17c05-056b-4f0d-9898-cef8af80d14e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:54.312641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c17c05-056b-4f0d-9898-cef8af80d14e None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:54.323929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 640/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:24:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:54.329800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315db8e-c72e-4c4f-b18f-1dca832fc592 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:54.418195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:54.427131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315db8e-c72e-4c4f-b18f-1dca832fc592 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:54.459648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b4536-a250-405f-a8d0-ccc2179bb5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:54.460294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b4536-a250-405f-a8d0-ccc2179bb5e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:54.460570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b4536-a250-405f-a8d0-ccc2179bb5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:54.460842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b4536-a250-405f-a8d0-ccc2179bb5e8 None admin] PATH_INFO: `/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/6a4030325cf0481ab634e253cfed9c77/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:54.463224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b4536-a250-405f-a8d0-ccc2179bb5e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=59e48b55267f4e5bb04399e6f49ad053, user_id=6a4030325cf0481ab634e253cfed9c77, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:54.464656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b4536-a250-405f-a8d0-ccc2179bb5e8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:54.476813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 633/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Oct 4 08:24:54 2022] PUT /identity/v3/projects/59e48b55267f4e5bb04399e6f49ad053/users/6a4030325cf0481ab634e253cfed9c77/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:24:56.573171 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af8f5-e7ed-4f28-bcd8-580c0e67cd15 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:56.573704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af8f5-e7ed-4f28-bcd8-580c0e67cd15 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:56.573704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af8f5-e7ed-4f28-bcd8-580c0e67cd15 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:56.575080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 641/1274] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:24:56.580355 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80641725-c0fc-4422-95dc-73464a24ed82 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:56.580751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80641725-c0fc-4422-95dc-73464a24ed82 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:56.580900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80641725-c0fc-4422-95dc-73464a24ed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:56.599335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-80641725-c0fc-4422-95dc-73464a24ed82 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:24:56.600521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-80641725-c0fc-4422-95dc-73464a24ed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:24:56.664015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 634/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:24:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:24:56.929657 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af8f5-e7ed-4f28-bcd8-580c0e67cd15 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:57.028001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af8f5-e7ed-4f28-bcd8-580c0e67cd15 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:57.044233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:57.060956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c381e2-abcc-4ab2-b6f8-359849d80aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:57.061573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c381e2-abcc-4ab2-b6f8-359849d80aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:57.061851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c381e2-abcc-4ab2-b6f8-359849d80aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:57.062119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c381e2-abcc-4ab2-b6f8-359849d80aa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:57.072497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c381e2-abcc-4ab2-b6f8-359849d80aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-40c381e2-abcc-4ab2-b6f8-359849d80aa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:24:57.077262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:57.078347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:57.079597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 642/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Oct 4 08:24:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:57.084284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80641725-c0fc-4422-95dc-73464a24ed82 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:57.167647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:57.194161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80641725-c0fc-4422-95dc-73464a24ed82 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:57.235100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833e1e9-a2a2-4f02-8f13-8c06f7178486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:57.235701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833e1e9-a2a2-4f02-8f13-8c06f7178486 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:57.235985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833e1e9-a2a2-4f02-8f13-8c06f7178486 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:57.236259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833e1e9-a2a2-4f02-8f13-8c06f7178486 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:57.236919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833e1e9-a2a2-4f02-8f13-8c06f7178486 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:57.237225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833e1e9-a2a2-4f02-8f13-8c06f7178486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:57.238601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833e1e9-a2a2-4f02-8f13-8c06f7178486 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:57.247262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 635/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Oct 4 08:24:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:57.253225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c381e2-abcc-4ab2-b6f8-359849d80aa9 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:57.349766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c381e2-abcc-4ab2-b6f8-359849d80aa9 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:57.382107 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d48fa1-7749-42fc-88de-6d541dabddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:57.382735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48fa1-7749-42fc-88de-6d541dabddd1 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:57.383019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48fa1-7749-42fc-88de-6d541dabddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:57.383827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48fa1-7749-42fc-88de-6d541dabddd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:57.394200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d48fa1-7749-42fc-88de-6d541dabddd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:57.395665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d48fa1-7749-42fc-88de-6d541dabddd1 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-56d48fa1-7749-42fc-88de-6d541dabddd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:57.409783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:57.410973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:57.411907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:57.411907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:57.411907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:57.411907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 643/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:57.416789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833e1e9-a2a2-4f02-8f13-8c06f7178486 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:57.514943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833e1e9-a2a2-4f02-8f13-8c06f7178486 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:57.548154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6f27f-7335-4e53-af59-f034a4d0c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:57.548753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6f27f-7335-4e53-af59-f034a4d0c7ef None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:57.549036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6f27f-7335-4e53-af59-f034a4d0c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:57.549311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6f27f-7335-4e53-af59-f034a4d0c7ef None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:57.549945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6f27f-7335-4e53-af59-f034a4d0c7ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:57.550248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6f27f-7335-4e53-af59-f034a4d0c7ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:57.551640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6f27f-7335-4e53-af59-f034a4d0c7ef None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:57.563539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 636/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:57.569196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d48fa1-7749-42fc-88de-6d541dabddd1 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:57.598118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:57.665904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d48fa1-7749-42fc-88de-6d541dabddd1 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:57.698936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44f9a4-7a68-49c7-a623-70d65a11762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:57.699547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44f9a4-7a68-49c7-a623-70d65a11762f None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:57.699826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44f9a4-7a68-49c7-a623-70d65a11762f None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:57.700098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44f9a4-7a68-49c7-a623-70d65a11762f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:57.707180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44f9a4-7a68-49c7-a623-70d65a11762f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:57.708613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44f9a4-7a68-49c7-a623-70d65a11762f None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-cc44f9a4-7a68-49c7-a623-70d65a11762f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:24:57.719550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:57.720639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:24:57.721780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 644/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:57.726356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6f27f-7335-4e53-af59-f034a4d0c7ef None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:57.730625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:57.825321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6f27f-7335-4e53-af59-f034a4d0c7ef None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:57.857672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c6874-ee36-40f8-b065-b6daca392eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:57.858260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c6874-ee36-40f8-b065-b6daca392eeb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:57.858537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c6874-ee36-40f8-b065-b6daca392eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:57.858842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c6874-ee36-40f8-b065-b6daca392eeb None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:57.859553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c6874-ee36-40f8-b065-b6daca392eeb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:57.859857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c6874-ee36-40f8-b065-b6daca392eeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:57.861267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c6874-ee36-40f8-b065-b6daca392eeb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:57.877938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 637/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Oct 4 08:24:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:57.883777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44f9a4-7a68-49c7-a623-70d65a11762f None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:57.970979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:57.981366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44f9a4-7a68-49c7-a623-70d65a11762f None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:58.013175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb0906-771a-4ec0-ae0b-765cfd641a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:58.013771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb0906-771a-4ec0-ae0b-765cfd641a06 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:58.014051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb0906-771a-4ec0-ae0b-765cfd641a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:58.014325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb0906-771a-4ec0-ae0b-765cfd641a06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:58.082898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb0906-771a-4ec0-ae0b-765cfd641a06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:58.084345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb0906-771a-4ec0-ae0b-765cfd641a06 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:58.169383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:58.179887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 645/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Oct 4 08:24:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:24:58.185888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c6874-ee36-40f8-b065-b6daca392eeb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:58.244574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:58.281551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c6874-ee36-40f8-b065-b6daca392eeb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:58.314379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc4c0f-14e0-4f5a-be60-45c734221341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:58.315014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc4c0f-14e0-4f5a-be60-45c734221341 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:58.315293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc4c0f-14e0-4f5a-be60-45c734221341 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:58.315564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc4c0f-14e0-4f5a-be60-45c734221341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:58.325899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc4c0f-14e0-4f5a-be60-45c734221341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:58.327419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc4c0f-14e0-4f5a-be60-45c734221341 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a4cc4c0f-14e0-4f5a-be60-45c734221341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:24:58.342843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:58.343955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:24:58.345039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:24:58.345039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:24:58.345039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:58.345039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 638/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:58.349758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb0906-771a-4ec0-ae0b-765cfd641a06 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:58.443021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb0906-771a-4ec0-ae0b-765cfd641a06 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:58.476088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb899d-c009-4635-bef0-c42b06caf176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:58.476681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb899d-c009-4635-bef0-c42b06caf176 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:58.477031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb899d-c009-4635-bef0-c42b06caf176 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:58.477309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb899d-c009-4635-bef0-c42b06caf176 None admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:58.477934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb899d-c009-4635-bef0-c42b06caf176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:58.478233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb899d-c009-4635-bef0-c42b06caf176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:58.479595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb899d-c009-4635-bef0-c42b06caf176 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:58.490285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 646/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Oct 4 08:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:58.495926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc4c0f-14e0-4f5a-be60-45c734221341 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:58.591474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc4c0f-14e0-4f5a-be60-45c734221341 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:58.604677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:58.623980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e487f5-7dac-4c33-b6a9-2306387dcfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:58.624589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e487f5-7dac-4c33-b6a9-2306387dcfbe None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:58.624864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e487f5-7dac-4c33-b6a9-2306387dcfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:58.625130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e487f5-7dac-4c33-b6a9-2306387dcfbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:58.631374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e487f5-7dac-4c33-b6a9-2306387dcfbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:58.632801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e487f5-7dac-4c33-b6a9-2306387dcfbe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-61e487f5-7dac-4c33-b6a9-2306387dcfbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:24:58.644116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:24:58.645134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:24:58.646243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:24:58.646243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:24:58.646243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:24:58.646243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:24:58.646243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:24:58.646243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:24:58.646243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:24:58.646243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Oct 04 08:24:58.646243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 639/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Oct 4 08:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:24:58.651565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb899d-c009-4635-bef0-c42b06caf176 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:58.699535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:24:58.746334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb899d-c009-4635-bef0-c42b06caf176 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:58.777978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf2618-b5f5-4971-92a0-e08ed0fe7240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:58.778565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf2618-b5f5-4971-92a0-e08ed0fe7240 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:58.778870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf2618-b5f5-4971-92a0-e08ed0fe7240 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:58.779141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf2618-b5f5-4971-92a0-e08ed0fe7240 None admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:58.779813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf2618-b5f5-4971-92a0-e08ed0fe7240 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:58.780116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf2618-b5f5-4971-92a0-e08ed0fe7240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:58.781519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf2618-b5f5-4971-92a0-e08ed0fe7240 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:58.792904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 647/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Oct 4 08:24:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:24:58.799848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e487f5-7dac-4c33-b6a9-2306387dcfbe None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:24:58.896569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e487f5-7dac-4c33-b6a9-2306387dcfbe None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:24:58.928925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef1093-8d5f-4cc6-a142-ab2f51e0e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:24:58.929510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef1093-8d5f-4cc6-a142-ab2f51e0e0cd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:24:58.929790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef1093-8d5f-4cc6-a142-ab2f51e0e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:24:58.930597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef1093-8d5f-4cc6-a142-ab2f51e0e0cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:24:58.931394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef1093-8d5f-4cc6-a142-ab2f51e0e0cd None admin] RBAC: Adding query filter params (role.id=5c27a729c8e54cbfac6c0f033f9e51b7, scope.project.id=59e48b55267f4e5bb04399e6f49ad053, user.id=6a4030325cf0481ab634e253cfed9c77) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:24:58.931702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef1093-8d5f-4cc6-a142-ab2f51e0e0cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:24:58.933121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef1093-8d5f-4cc6-a142-ab2f51e0e0cd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:24:58.938645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 640/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Oct 4 08:24:58 2022] GET /identity/v3/role_assignments?user.id=6a4030325cf0481ab634e253cfed9c77&scope.project.id=59e48b55267f4e5bb04399e6f49ad053&role.id=5c27a729c8e54cbfac6c0f033f9e51b7 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:25:01.077456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6a6f-c9a3-4ff2-8251-00ae7ee051cf None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:01.078013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6a6f-c9a3-4ff2-8251-00ae7ee051cf None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:01.078013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6a6f-c9a3-4ff2-8251-00ae7ee051cf None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:01.079482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 648/1288] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:25:01.084552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8778a3d-dd71-4645-b40a-8b5ff3d20e54 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:01.084945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8778a3d-dd71-4645-b40a-8b5ff3d20e54 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:01.085108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8778a3d-dd71-4645-b40a-8b5ff3d20e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:01.104696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d8778a3d-dd71-4645-b40a-8b5ff3d20e54 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:25:01.105888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d8778a3d-dd71-4645-b40a-8b5ff3d20e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:25:01.134017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:25:01.174892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 641/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:25:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:25:01.454726 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6a6f-c9a3-4ff2-8251-00ae7ee051cf None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:01.553519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6a6f-c9a3-4ff2-8251-00ae7ee051cf None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:01.563560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:25:01.587524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ae96a-f45a-4662-8b70-ef6aa370713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:01.588133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ae96a-f45a-4662-8b70-ef6aa370713d None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:01.588405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ae96a-f45a-4662-8b70-ef6aa370713d None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:01.588671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ae96a-f45a-4662-8b70-ef6aa370713d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:01.589241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ae96a-f45a-4662-8b70-ef6aa370713d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:01.590591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ae96a-f45a-4662-8b70-ef6aa370713d None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-9b6ae96a-f45a-4662-8b70-ef6aa370713d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:25:01.599060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:25:01.600284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:25:01.601393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 649/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Oct 4 08:25:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:25:01.606471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8778a3d-dd71-4645-b40a-8b5ff3d20e54 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:01.700321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8778a3d-dd71-4645-b40a-8b5ff3d20e54 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:01.732212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe52954-4a14-4a5c-805f-1719b18809c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:01.732744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe52954-4a14-4a5c-805f-1719b18809c5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:01.733019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe52954-4a14-4a5c-805f-1719b18809c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:01.733294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe52954-4a14-4a5c-805f-1719b18809c5 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:01.733906 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe52954-4a14-4a5c-805f-1719b18809c5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:25:01.734203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe52954-4a14-4a5c-805f-1719b18809c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:01.735583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe52954-4a14-4a5c-805f-1719b18809c5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:01.740189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 642/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Oct 4 08:25:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:25:01.746467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ae96a-f45a-4662-8b70-ef6aa370713d None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:01.842119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ae96a-f45a-4662-8b70-ef6aa370713d None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:01.874103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5e34-c50a-4359-aa16-2e4e97e80b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:01.874708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5e34-c50a-4359-aa16-2e4e97e80b56 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:01.874990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5e34-c50a-4359-aa16-2e4e97e80b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:01.875262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5e34-c50a-4359-aa16-2e4e97e80b56 None admin] PATH_INFO: `/v3/services` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:01.875878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5e34-c50a-4359-aa16-2e4e97e80b56 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:25:01.876183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5e34-c50a-4359-aa16-2e4e97e80b56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:01.877535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5e34-c50a-4359-aa16-2e4e97e80b56 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:01.881720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 650/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Oct 4 08:25:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:25:04.010538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ec223-99c8-4eda-b15e-57ff66cf9f89 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:04.011169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ec223-99c8-4eda-b15e-57ff66cf9f89 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:04.011169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ec223-99c8-4eda-b15e-57ff66cf9f89 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:04.012435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 643/1293] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:25:04.017760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea98347-a94c-4640-9a5a-e070ad766795 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:04.018162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea98347-a94c-4640-9a5a-e070ad766795 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:04.018308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea98347-a94c-4640-9a5a-e070ad766795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:04.037586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1ea98347-a94c-4640-9a5a-e070ad766795 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:25:04.038790 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1ea98347-a94c-4640-9a5a-e070ad766795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:25:04.069270 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:25:04.105651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 651/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:25:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:25:04.381396 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ec223-99c8-4eda-b15e-57ff66cf9f89 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:04.411301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:25:04.480100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ec223-99c8-4eda-b15e-57ff66cf9f89 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:04.512596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fc9a7-4464-4b3c-96b8-53ab6e62a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:04.513189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fc9a7-4464-4b3c-96b8-53ab6e62a495 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:04.513467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fc9a7-4464-4b3c-96b8-53ab6e62a495 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:04.513738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fc9a7-4464-4b3c-96b8-53ab6e62a495 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:04.514387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fc9a7-4464-4b3c-96b8-53ab6e62a495 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:04.515794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fc9a7-4464-4b3c-96b8-53ab6e62a495 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:04.529146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 644/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Oct 4 08:25:04 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:25:06.679536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37210-e7f0-40c3-9190-91af4f536ab7 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:06.680055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37210-e7f0-40c3-9190-91af4f536ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:06.680188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37210-e7f0-40c3-9190-91af4f536ab7 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:06.681522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 652/1296] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:25:06.686850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6370-37f2-41a2-ad2b-8890b3196775 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:06.687244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6370-37f2-41a2-ad2b-8890b3196775 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:06.687395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6370-37f2-41a2-ad2b-8890b3196775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:06.705340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eace6370-37f2-41a2-ad2b-8890b3196775 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:25:06.706506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eace6370-37f2-41a2-ad2b-8890b3196775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:25:06.776115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 645/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:25:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:25:07.043674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c37210-e7f0-40c3-9190-91af4f536ab7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:07.141784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c37210-e7f0-40c3-9190-91af4f536ab7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:07.176904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860355c-653a-4dd8-bd5a-edb795381d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:07.177532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860355c-653a-4dd8-bd5a-edb795381d28 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:07.177802 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860355c-653a-4dd8-bd5a-edb795381d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:07.178070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860355c-653a-4dd8-bd5a-edb795381d28 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:07.178642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860355c-653a-4dd8-bd5a-edb795381d28 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:07.180402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860355c-653a-4dd8-bd5a-edb795381d28 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-1860355c-653a-4dd8-bd5a-edb795381d28 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:25:07.189015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:25:07.190041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:25:07.191093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 653/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Oct 4 08:25:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:25:07.197852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace6370-37f2-41a2-ad2b-8890b3196775 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:07.219195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:25:07.298019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace6370-37f2-41a2-ad2b-8890b3196775 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:07.330237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4dde8-e1ba-4e41-9d6b-ad53126a27a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:07.330854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4dde8-e1ba-4e41-9d6b-ad53126a27a7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:07.331131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4dde8-e1ba-4e41-9d6b-ad53126a27a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:07.331402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4dde8-e1ba-4e41-9d6b-ad53126a27a7 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:07.332015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4dde8-e1ba-4e41-9d6b-ad53126a27a7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:25:07.332313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4dde8-e1ba-4e41-9d6b-ad53126a27a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:07.333660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4dde8-e1ba-4e41-9d6b-ad53126a27a7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:07.339234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 646/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Oct 4 08:25:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:25:07.345274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860355c-653a-4dd8-bd5a-edb795381d28 None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:07.376138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:25:07.445651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860355c-653a-4dd8-bd5a-edb795381d28 None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:07.479313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba4792-0059-42e2-bda9-c34a51a2a482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:07.479918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba4792-0059-42e2-bda9-c34a51a2a482 None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:07.480198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba4792-0059-42e2-bda9-c34a51a2a482 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:07.480471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba4792-0059-42e2-bda9-c34a51a2a482 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:07.481161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba4792-0059-42e2-bda9-c34a51a2a482 None admin] RBAC: Adding query filter params (interface=public, service_id=d0bb5550032c4f3abe102b506c7b27ca, region_id=RegionOne) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:25:07.481471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba4792-0059-42e2-bda9-c34a51a2a482 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:07.482860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba4792-0059-42e2-bda9-c34a51a2a482 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:07.487715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 654/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Oct 4 08:25:07 2022] GET /identity/v3/endpoints?service_id=d0bb5550032c4f3abe102b506c7b27ca&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:25:07.493933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4dde8-e1ba-4e41-9d6b-ad53126a27a7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:07.572830 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:25:07.590278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4dde8-e1ba-4e41-9d6b-ad53126a27a7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:07.623722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90d7d4-0a0c-4b87-8bbe-403846bfbb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:07.624313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90d7d4-0a0c-4b87-8bbe-403846bfbb15 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:07.624589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90d7d4-0a0c-4b87-8bbe-403846bfbb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:07.624855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90d7d4-0a0c-4b87-8bbe-403846bfbb15 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:07.625444 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90d7d4-0a0c-4b87-8bbe-403846bfbb15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:07.626828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90d7d4-0a0c-4b87-8bbe-403846bfbb15 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:07.633337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 647/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Oct 4 08:25:07 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:25:09.772862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047748e2-4590-43b9-9d46-d4648ceca3b7 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:09.773413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047748e2-4590-43b9-9d46-d4648ceca3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:09.773516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047748e2-4590-43b9-9d46-d4648ceca3b7 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:09.774858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 655/1302] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:25:09.780142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9703c-3673-4b0a-96dd-a172b5ae99c2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:09.780566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9703c-3673-4b0a-96dd-a172b5ae99c2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:09.780693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9703c-3673-4b0a-96dd-a172b5ae99c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:09.799351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-97e9703c-3673-4b0a-96dd-a172b5ae99c2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:25:09.800536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-97e9703c-3673-4b0a-96dd-a172b5ae99c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:25:09.864161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 648/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:25:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:25:10.134621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047748e2-4590-43b9-9d46-d4648ceca3b7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:10.227617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:25:10.234229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047748e2-4590-43b9-9d46-d4648ceca3b7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:10.265713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99a330-1339-40be-a9fc-36f1eb82c9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:10.266325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99a330-1339-40be-a9fc-36f1eb82c9ee None admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:10.266603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99a330-1339-40be-a9fc-36f1eb82c9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:10.266907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99a330-1339-40be-a9fc-36f1eb82c9ee None admin] PATH_INFO: `/v3/services/placement` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:10.267479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99a330-1339-40be-a9fc-36f1eb82c9ee None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:10.268824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99a330-1339-40be-a9fc-36f1eb82c9ee None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application [None req-6e99a330-1339-40be-a9fc-36f1eb82c9ee None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:25:10.278390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:25:10.279508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application with Lock( Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: ERROR keystone.server.flask.application Oct 04 08:25:10.280446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 656/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Oct 4 08:25:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:25:10.285550 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9703c-3673-4b0a-96dd-a172b5ae99c2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:10.358283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:25:10.380248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9703c-3673-4b0a-96dd-a172b5ae99c2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:10.413176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9ea29-7807-4785-ba66-0c45f301077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:10.413763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ea29-7807-4785-ba66-0c45f301077f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:10.414040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ea29-7807-4785-ba66-0c45f301077f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:10.414299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ea29-7807-4785-ba66-0c45f301077f None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:10.414953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9ea29-7807-4785-ba66-0c45f301077f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:25:10.415260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9ea29-7807-4785-ba66-0c45f301077f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:10.416610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9ea29-7807-4785-ba66-0c45f301077f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:10.421703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 649/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Oct 4 08:25:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:25:10.427414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99a330-1339-40be-a9fc-36f1eb82c9ee None admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:25:10.522884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99a330-1339-40be-a9fc-36f1eb82c9ee None admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:25:10.555706 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb4755-06e8-4d97-a96c-195331c95b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:25:10.556296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb4755-06e8-4d97-a96c-195331c95b67 None admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:25:10.556573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb4755-06e8-4d97-a96c-195331c95b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:25:10.556842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb4755-06e8-4d97-a96c-195331c95b67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:25:10.557496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb4755-06e8-4d97-a96c-195331c95b67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:25:10.558865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb4755-06e8-4d97-a96c-195331c95b67 None admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:25:10.577309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 657/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:25:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:25:20.418647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=30 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:25:20.573261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:15.213497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39ecc-d5df-4797-b592-1c5df8c44940 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:15.214326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39ecc-d5df-4797-b592-1c5df8c44940 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:15.214326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39ecc-d5df-4797-b592-1c5df8c44940 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:15.215731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 650/1307] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:15.220835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311915b-2de1-4bde-bcaf-2f6864c88eb3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:15.221352 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311915b-2de1-4bde-bcaf-2f6864c88eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:15.221488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311915b-2de1-4bde-bcaf-2f6864c88eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:15.310874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9311915b-2de1-4bde-bcaf-2f6864c88eb3 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:15.312119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9311915b-2de1-4bde-bcaf-2f6864c88eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:15.437288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 658/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:15.739810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e03d4b-d7f6-4592-ba86-7ba7ec62fa81 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:15.740097 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e03d4b-d7f6-4592-ba86-7ba7ec62fa81 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:15.740372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e03d4b-d7f6-4592-ba86-7ba7ec62fa81 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:15.741711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 651/1309] 10.222.0.23 () {54 vars in 964 bytes} [Tue Oct 4 08:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:15.749014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8363e-10ed-4a32-b236-eedc800a3ad4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:15.749305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8363e-10ed-4a32-b236-eedc800a3ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:15.749589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8363e-10ed-4a32-b236-eedc800a3ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:15.838078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-07b8363e-10ed-4a32-b236-eedc800a3ad4 None None] MFA Rules not processed for user `9a186bffa7854d34b91edfa4eb4b2498`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:15.839332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-07b8363e-10ed-4a32-b236-eedc800a3ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:15.861672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:15.923381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 659/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Tue Oct 4 08:26:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:15.933479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e03d4b-d7f6-4592-ba86-7ba7ec62fa81 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:15.935263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e9e03d4b-d7f6-4592-ba86-7ba7ec62fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:16.054135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e03d4b-d7f6-4592-ba86-7ba7ec62fa81 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:16.133706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593cbdf-db4f-4c6c-9660-16d0f167d8a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:16.134330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593cbdf-db4f-4c6c-9660-16d0f167d8a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:16.134609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593cbdf-db4f-4c6c-9660-16d0f167d8a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:16.134911 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593cbdf-db4f-4c6c-9660-16d0f167d8a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:16.136519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b593cbdf-db4f-4c6c-9660-16d0f167d8a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:16.199534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:16.261573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593cbdf-db4f-4c6c-9660-16d0f167d8a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:16.263073 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593cbdf-db4f-4c6c-9660-16d0f167d8a4 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:16.282972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 652/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:18.824606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac41fed-397f-4a78-9fe2-276cca69f9f1 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:18.825151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac41fed-397f-4a78-9fe2-276cca69f9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:18.825151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac41fed-397f-4a78-9fe2-276cca69f9f1 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:18.826494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 660/1312] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:18.832403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cca4b3-4d83-4ad0-9259-6a34712168a0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:18.832799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cca4b3-4d83-4ad0-9259-6a34712168a0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:18.832967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cca4b3-4d83-4ad0-9259-6a34712168a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:18.904888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d0cca4b3-4d83-4ad0-9259-6a34712168a0 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:18.906097 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d0cca4b3-4d83-4ad0-9259-6a34712168a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:19.001912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 653/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:19.286221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac41fed-397f-4a78-9fe2-276cca69f9f1 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:19.287819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0ac41fed-397f-4a78-9fe2-276cca69f9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:19.399894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac41fed-397f-4a78-9fe2-276cca69f9f1 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:19.473633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:19.476278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f808b97-3347-4b99-82d0-b92bff7a34cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:19.477081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f808b97-3347-4b99-82d0-b92bff7a34cd service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:19.477519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f808b97-3347-4b99-82d0-b92bff7a34cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:19.477960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f808b97-3347-4b99-82d0-b92bff7a34cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:19.479608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8f808b97-3347-4b99-82d0-b92bff7a34cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:19.587277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f808b97-3347-4b99-82d0-b92bff7a34cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:19.588636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f808b97-3347-4b99-82d0-b92bff7a34cd service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:19.607119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 661/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:22.104569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902366cb-b171-42d2-b109-9b19fd9c5454 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:22.105100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902366cb-b171-42d2-b109-9b19fd9c5454 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:22.105226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902366cb-b171-42d2-b109-9b19fd9c5454 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:22.106461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 654/1315] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:22.111669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9ab11-27fd-4b25-957c-81cccf2b40a7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:22.112090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9ab11-27fd-4b25-957c-81cccf2b40a7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:22.112309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9ab11-27fd-4b25-957c-81cccf2b40a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:22.179309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0ec9ab11-27fd-4b25-957c-81cccf2b40a7 None None] MFA Rules not processed for user `5b8bc8c97d8b42988e9534a42c6e4196`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:22.180461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0ec9ab11-27fd-4b25-957c-81cccf2b40a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:22.231871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:22.278898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 662/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:22.568122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902366cb-b171-42d2-b109-9b19fd9c5454 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:22.569664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-902366cb-b171-42d2-b109-9b19fd9c5454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:22.579255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:22.670560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902366cb-b171-42d2-b109-9b19fd9c5454 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:22.741943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c33bb6-49c2-492d-98f4-cc9c5ef7295d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:22.742469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c33bb6-49c2-492d-98f4-cc9c5ef7295d service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:22.742773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c33bb6-49c2-492d-98f4-cc9c5ef7295d service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:22.743046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c33bb6-49c2-492d-98f4-cc9c5ef7295d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:22.744621 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-02c33bb6-49c2-492d-98f4-cc9c5ef7295d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:22.805596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:22.851589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c33bb6-49c2-492d-98f4-cc9c5ef7295d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:22.853024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c33bb6-49c2-492d-98f4-cc9c5ef7295d service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:22.871318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 655/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:25.569240 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5a98a-310a-4b6a-bcf2-51e8ced1af4d None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:25.569768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5a98a-310a-4b6a-bcf2-51e8ced1af4d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:25.569768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5a98a-310a-4b6a-bcf2-51e8ced1af4d None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:25.571154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 663/1318] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:25.576254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df2f5-1416-4077-81d0-02a6562cb733 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:25.576688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df2f5-1416-4077-81d0-02a6562cb733 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:25.576793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df2f5-1416-4077-81d0-02a6562cb733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:25.641513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0f2df2f5-1416-4077-81d0-02a6562cb733 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:25.643308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0f2df2f5-1416-4077-81d0-02a6562cb733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:25.736970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 656/1319] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:26.019994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5a98a-310a-4b6a-bcf2-51e8ced1af4d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:26.021538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2ef5a98a-310a-4b6a-bcf2-51e8ced1af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:26.122938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5a98a-310a-4b6a-bcf2-51e8ced1af4d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:26.198233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c644f8f-b9a2-41c8-ad79-04e6ecea942d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:26.198857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c644f8f-b9a2-41c8-ad79-04e6ecea942d service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:26.199135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c644f8f-b9a2-41c8-ad79-04e6ecea942d service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:26.199404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c644f8f-b9a2-41c8-ad79-04e6ecea942d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:26.200998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5c644f8f-b9a2-41c8-ad79-04e6ecea942d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:26.208321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:26.307668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c644f8f-b9a2-41c8-ad79-04e6ecea942d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:26.309015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c644f8f-b9a2-41c8-ad79-04e6ecea942d service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:26.326871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 664/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:29.122936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8cc1a-decc-4f60-a5c8-3ddeab84a6c4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:29.123477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8cc1a-decc-4f60-a5c8-3ddeab84a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:29.123477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8cc1a-decc-4f60-a5c8-3ddeab84a6c4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:29.124813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 657/1321] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:29.130652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14133d9-155d-4bf3-a530-fbdcb7cb9782 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:29.131078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14133d9-155d-4bf3-a530-fbdcb7cb9782 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:29.131250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14133d9-155d-4bf3-a530-fbdcb7cb9782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:29.203751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d14133d9-155d-4bf3-a530-fbdcb7cb9782 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:29.205670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d14133d9-155d-4bf3-a530-fbdcb7cb9782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:29.267055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:29.309425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 665/1322] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:29.593970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8cc1a-decc-4f60-a5c8-3ddeab84a6c4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:29.595609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-52b8cc1a-decc-4f60-a5c8-3ddeab84a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:29.615208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:29.699576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8cc1a-decc-4f60-a5c8-3ddeab84a6c4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:29.772484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c931d-72c9-4fa0-bf4d-3104f668261d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:29.772994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c931d-72c9-4fa0-bf4d-3104f668261d service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:29.773268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c931d-72c9-4fa0-bf4d-3104f668261d service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:29.773534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c931d-72c9-4fa0-bf4d-3104f668261d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:29.775141 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a68c931d-72c9-4fa0-bf4d-3104f668261d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:29.845175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:29.884196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c931d-72c9-4fa0-bf4d-3104f668261d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:29.885645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c931d-72c9-4fa0-bf4d-3104f668261d service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:29.903315 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 658/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:32.209310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2708c-6876-4d4d-9f17-4c79da8460aa None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:32.209822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2708c-6876-4d4d-9f17-4c79da8460aa None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:32.209822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2708c-6876-4d4d-9f17-4c79da8460aa None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:32.211176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 666/1324] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:32.216857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f702-9313-46c5-ae15-c99821d249ae None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:32.217304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f702-9313-46c5-ae15-c99821d249ae None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:32.217399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f702-9313-46c5-ae15-c99821d249ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:32.292406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-30e5f702-9313-46c5-ae15-c99821d249ae None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:32.293952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-30e5f702-9313-46c5-ae15-c99821d249ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:32.393612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 659/1325] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:32.694784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9e712-4df0-470b-bfff-0d5cbdda4186 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:32.695178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9e712-4df0-470b-bfff-0d5cbdda4186 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:32.695516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9e712-4df0-470b-bfff-0d5cbdda4186 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:32.696924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 667/1326] 10.222.0.23 () {54 vars in 964 bytes} [Tue Oct 4 08:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:32.703017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e13e-7214-4309-9e4b-2b722aa3493a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:32.703385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e13e-7214-4309-9e4b-2b722aa3493a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:32.703728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e13e-7214-4309-9e4b-2b722aa3493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:32.742517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:32.788501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ebe7e13e-7214-4309-9e4b-2b722aa3493a None None] MFA Rules not processed for user `9a186bffa7854d34b91edfa4eb4b2498`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:32.789732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ebe7e13e-7214-4309-9e4b-2b722aa3493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:32.869569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 660/1327] 10.222.0.23 () {58 vars in 1061 bytes} [Tue Oct 4 08:26:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:26:32.878692 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9e712-4df0-470b-bfff-0d5cbdda4186 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:32.880225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-86f9e712-4df0-470b-bfff-0d5cbdda4186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:32.984993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9e712-4df0-470b-bfff-0d5cbdda4186 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:33.067186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e4460-91a1-4700-9659-d7408461d6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:33.067716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e4460-91a1-4700-9659-d7408461d6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:33.067986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e4460-91a1-4700-9659-d7408461d6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:33.068252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e4460-91a1-4700-9659-d7408461d6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:33.069835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f14e4460-91a1-4700-9659-d7408461d6f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:33.086173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:33.176861 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e4460-91a1-4700-9659-d7408461d6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:33.178362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e4460-91a1-4700-9659-d7408461d6f7 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:33.196532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 668/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:35.659601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9beb0-10ca-405d-913a-7f9bb5248b3a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:35.660136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9beb0-10ca-405d-913a-7f9bb5248b3a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:35.660136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9beb0-10ca-405d-913a-7f9bb5248b3a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:35.661510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 661/1329] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:35.667109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66189d3e-e1bd-466b-a754-fb9eb8e992d7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:35.667552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66189d3e-e1bd-466b-a754-fb9eb8e992d7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:35.667901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66189d3e-e1bd-466b-a754-fb9eb8e992d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:35.738405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-66189d3e-e1bd-466b-a754-fb9eb8e992d7 None None] MFA Rules not processed for user `5b8bc8c97d8b42988e9534a42c6e4196`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:35.739758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-66189d3e-e1bd-466b-a754-fb9eb8e992d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:35.806448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:35.838516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 669/1330] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:36.122764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9beb0-10ca-405d-913a-7f9bb5248b3a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:36.124304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-90b9beb0-10ca-405d-913a-7f9bb5248b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:36.230897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9beb0-10ca-405d-913a-7f9bb5248b3a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:36.254578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:36.312457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f1a30-a90e-48d3-9ba2-6088faa9dd7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:36.313069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f1a30-a90e-48d3-9ba2-6088faa9dd7f service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:36.313349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f1a30-a90e-48d3-9ba2-6088faa9dd7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:36.313683 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f1a30-a90e-48d3-9ba2-6088faa9dd7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:36.316423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-587f1a30-a90e-48d3-9ba2-6088faa9dd7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:36.434203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f1a30-a90e-48d3-9ba2-6088faa9dd7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:36.435944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f1a30-a90e-48d3-9ba2-6088faa9dd7f service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:36.457913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 662/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:38.976863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6e6f7-9782-4d1e-b8b3-f26a87d0013b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:38.977427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6e6f7-9782-4d1e-b8b3-f26a87d0013b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:38.977757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6e6f7-9782-4d1e-b8b3-f26a87d0013b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:38.979749 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 670/1332] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:38.987387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad55c-a3a9-4b28-b7de-a86e117e52f8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:38.987845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad55c-a3a9-4b28-b7de-a86e117e52f8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:38.987935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad55c-a3a9-4b28-b7de-a86e117e52f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:39.066640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:39.070626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6cdad55c-a3a9-4b28-b7de-a86e117e52f8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:39.072569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6cdad55c-a3a9-4b28-b7de-a86e117e52f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:39.173567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 663/1333] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:39.456664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6e6f7-9782-4d1e-b8b3-f26a87d0013b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:39.458209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-03c6e6f7-9782-4d1e-b8b3-f26a87d0013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:39.560459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6e6f7-9782-4d1e-b8b3-f26a87d0013b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:39.632228 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50435a-1c8c-40f7-8399-db75d15af990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:39.632825 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50435a-1c8c-40f7-8399-db75d15af990 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:39.633097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50435a-1c8c-40f7-8399-db75d15af990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:39.633364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50435a-1c8c-40f7-8399-db75d15af990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:39.634957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fd50435a-1c8c-40f7-8399-db75d15af990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:39.662641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:39.742392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50435a-1c8c-40f7-8399-db75d15af990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:39.743790 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50435a-1c8c-40f7-8399-db75d15af990 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:39.762008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 671/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:41.967516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c44ac7-f7cf-4c78-8929-179f8885d17e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:41.968102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c44ac7-f7cf-4c78-8929-179f8885d17e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:41.968102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c44ac7-f7cf-4c78-8929-179f8885d17e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:41.969996 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 664/1335] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:41.975306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72edccf-426d-49b3-8568-d8cf4660f184 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:41.975757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72edccf-426d-49b3-8568-d8cf4660f184 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:41.975866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72edccf-426d-49b3-8568-d8cf4660f184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:42.040608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d72edccf-426d-49b3-8568-d8cf4660f184 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:42.041798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d72edccf-426d-49b3-8568-d8cf4660f184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:42.114392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:42.136110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 672/1336] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:42.422130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c44ac7-f7cf-4c78-8929-179f8885d17e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:42.423765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-58c44ac7-f7cf-4c78-8929-179f8885d17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:42.525377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c44ac7-f7cf-4c78-8929-179f8885d17e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:42.552866 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:42.597220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe83e2-d692-40ef-b1b0-a68e959d752c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:42.597814 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe83e2-d692-40ef-b1b0-a68e959d752c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:42.598090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe83e2-d692-40ef-b1b0-a68e959d752c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:42.598357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe83e2-d692-40ef-b1b0-a68e959d752c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:42.599972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f7fe83e2-d692-40ef-b1b0-a68e959d752c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:42.705518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe83e2-d692-40ef-b1b0-a68e959d752c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:42.706967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe83e2-d692-40ef-b1b0-a68e959d752c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:42.725749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 665/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:45.215402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700009b4-c8df-4c4e-b21a-62838cb41092 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:45.215860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700009b4-c8df-4c4e-b21a-62838cb41092 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:45.215962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700009b4-c8df-4c4e-b21a-62838cb41092 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:45.217302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 673/1338] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:45.222603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2edfc4-35f0-43f2-9a3c-4fa0af5793cc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:45.223052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2edfc4-35f0-43f2-9a3c-4fa0af5793cc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:45.223190 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2edfc4-35f0-43f2-9a3c-4fa0af5793cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:45.288209 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ca2edfc4-35f0-43f2-9a3c-4fa0af5793cc None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:45.289419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ca2edfc4-35f0-43f2-9a3c-4fa0af5793cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:45.298302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:45.384496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 666/1339] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:45.667145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700009b4-c8df-4c4e-b21a-62838cb41092 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:45.668942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-700009b4-c8df-4c4e-b21a-62838cb41092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:45.769650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700009b4-c8df-4c4e-b21a-62838cb41092 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:45.841441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3276a4-8df1-411e-93d6-3ff550cb1ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:45.842038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3276a4-8df1-411e-93d6-3ff550cb1ffb service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:45.842314 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3276a4-8df1-411e-93d6-3ff550cb1ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:45.842589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3276a4-8df1-411e-93d6-3ff550cb1ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:45.844822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6d3276a4-8df1-411e-93d6-3ff550cb1ffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:45.881046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:45.952461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3276a4-8df1-411e-93d6-3ff550cb1ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:45.954426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3276a4-8df1-411e-93d6-3ff550cb1ffb service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:45.972790 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 674/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:50.084617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703200-2ae5-4de7-8a82-29641997e0b6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:50.085117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703200-2ae5-4de7-8a82-29641997e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:50.085117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703200-2ae5-4de7-8a82-29641997e0b6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:50.086400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 667/1341] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:50.091516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306cfa-b588-44cf-807a-d8850f4cf7d6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:50.091922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306cfa-b588-44cf-807a-d8850f4cf7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:50.092065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306cfa-b588-44cf-807a-d8850f4cf7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:50.161633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5d306cfa-b588-44cf-807a-d8850f4cf7d6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:50.163066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5d306cfa-b588-44cf-807a-d8850f4cf7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:50.248900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:50.261419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 675/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:50.545973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f703200-2ae5-4de7-8a82-29641997e0b6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:50.548155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2f703200-2ae5-4de7-8a82-29641997e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:50.657422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f703200-2ae5-4de7-8a82-29641997e0b6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:50.697305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:50.735050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f30d8-3c4f-4ffe-bdf4-a3b394ed2979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:50.735652 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f30d8-3c4f-4ffe-bdf4-a3b394ed2979 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:50.735929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f30d8-3c4f-4ffe-bdf4-a3b394ed2979 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:50.736198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f30d8-3c4f-4ffe-bdf4-a3b394ed2979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:50.737767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6c3f30d8-3c4f-4ffe-bdf4-a3b394ed2979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:50.846056 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f30d8-3c4f-4ffe-bdf4-a3b394ed2979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:50.847538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f30d8-3c4f-4ffe-bdf4-a3b394ed2979 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:50.865600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 668/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:54.073973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a400b2-dce9-477a-b54b-13a6a7ddc8e6 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:54.074565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a400b2-dce9-477a-b54b-13a6a7ddc8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:54.074565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a400b2-dce9-477a-b54b-13a6a7ddc8e6 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:54.075987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 676/1344] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:54.082249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c6c0a-6981-4946-8531-5649cf176cbc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:54.082775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c6c0a-6981-4946-8531-5649cf176cbc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:54.082865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c6c0a-6981-4946-8531-5649cf176cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:54.154772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ae9c6c0a-6981-4946-8531-5649cf176cbc None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:54.156128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ae9c6c0a-6981-4946-8531-5649cf176cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:54.178510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:54.269236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 669/1345] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:54.556179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a400b2-dce9-477a-b54b-13a6a7ddc8e6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:54.557734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-34a400b2-dce9-477a-b54b-13a6a7ddc8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:54.689274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a400b2-dce9-477a-b54b-13a6a7ddc8e6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:54.775290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840c9e-8bff-417d-8b74-7391e84e9c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:54.775896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840c9e-8bff-417d-8b74-7391e84e9c94 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:54.776168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840c9e-8bff-417d-8b74-7391e84e9c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:54.776442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840c9e-8bff-417d-8b74-7391e84e9c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:54.778042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8c840c9e-8bff-417d-8b74-7391e84e9c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:54.823849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:54.895204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c840c9e-8bff-417d-8b74-7391e84e9c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:54.896658 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c840c9e-8bff-417d-8b74-7391e84e9c94 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:54.916037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 677/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:26:59.080560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2532ad-2b8b-4152-ad64-def0dd701120 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:59.081038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2532ad-2b8b-4152-ad64-def0dd701120 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:59.081120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2532ad-2b8b-4152-ad64-def0dd701120 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:59.082455 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 670/1347] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:26:59.088191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f4f8d-9783-4391-9275-dcdd585a631f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:59.088668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f4f8d-9783-4391-9275-dcdd585a631f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:59.088768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f4f8d-9783-4391-9275-dcdd585a631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:59.157877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-332f4f8d-9783-4391-9275-dcdd585a631f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:26:59.159164 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-332f4f8d-9783-4391-9275-dcdd585a631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:59.255694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:59.258007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 678/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:26:59.553980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2532ad-2b8b-4152-ad64-def0dd701120 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:26:59.555574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7e2532ad-2b8b-4152-ad64-def0dd701120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:59.657292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2532ad-2b8b-4152-ad64-def0dd701120 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:26:59.703741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:26:59.728924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afe90c-2852-4bed-a812-ff514e5e96f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:26:59.729454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe90c-2852-4bed-a812-ff514e5e96f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:26:59.729729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe90c-2852-4bed-a812-ff514e5e96f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:26:59.729996 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe90c-2852-4bed-a812-ff514e5e96f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:26:59.731598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-50afe90c-2852-4bed-a812-ff514e5e96f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:26:59.837264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afe90c-2852-4bed-a812-ff514e5e96f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:26:59.838731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afe90c-2852-4bed-a812-ff514e5e96f7 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:26:59.857584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 671/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:27:04.826267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe0535-a3ed-43ee-bd28-41df34e54f31 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:04.826650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe0535-a3ed-43ee-bd28-41df34e54f31 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:04.826650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe0535-a3ed-43ee-bd28-41df34e54f31 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:04.829326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 679/1350] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:04.834019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efdb91-f91f-4282-b801-cb8d7d48921d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:04.835031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efdb91-f91f-4282-b801-cb8d7d48921d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:04.835508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efdb91-f91f-4282-b801-cb8d7d48921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:04.934623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a6efdb91-f91f-4282-b801-cb8d7d48921d None None] MFA Rules not processed for user `6a4030325cf0481ab634e253cfed9c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:04.936216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6efdb91-f91f-4282-b801-cb8d7d48921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:04.982454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:05.125521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 672/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:09.307857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc5759-ae16-44c0-8b69-574a39c306b9 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:09.308383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc5759-ae16-44c0-8b69-574a39c306b9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:09.308383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc5759-ae16-44c0-8b69-574a39c306b9 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:09.309978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 680/1352] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:09.315105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525965-aede-4862-be78-fe662e0510af None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:09.315528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525965-aede-4862-be78-fe662e0510af None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:09.315749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525965-aede-4862-be78-fe662e0510af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:09.397839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b4525965-aede-4862-be78-fe662e0510af None None] MFA Rules not processed for user `6a4030325cf0481ab634e253cfed9c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:09.399696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b4525965-aede-4862-be78-fe662e0510af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:09.486982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:09.525308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 673/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:27:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:10.880322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844fdb1-af27-4286-8666-6a7800abf1f7 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:10.880892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844fdb1-af27-4286-8666-6a7800abf1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:10.880892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844fdb1-af27-4286-8666-6a7800abf1f7 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:10.882187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 681/1354] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:10.887103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7393fab-80ed-4214-bf47-c311fc3483ac None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:10.887522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7393fab-80ed-4214-bf47-c311fc3483ac None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:10.887805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7393fab-80ed-4214-bf47-c311fc3483ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:10.966977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e7393fab-80ed-4214-bf47-c311fc3483ac None None] MFA Rules not processed for user `6a4030325cf0481ab634e253cfed9c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:10.968858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e7393fab-80ed-4214-bf47-c311fc3483ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:11.077422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 674/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:27:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:14.736019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19769e11-392d-45f2-b212-85baaf77f9b7 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:14.737015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19769e11-392d-45f2-b212-85baaf77f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:14.737497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19769e11-392d-45f2-b212-85baaf77f9b7 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:14.739173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 682/1356] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:14.744777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359b396-b804-4105-b27e-8491a2dfe8da None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:14.745207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359b396-b804-4105-b27e-8491a2dfe8da None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:14.745385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359b396-b804-4105-b27e-8491a2dfe8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:14.785493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:14.819632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0359b396-b804-4105-b27e-8491a2dfe8da None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:14.820971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0359b396-b804-4105-b27e-8491a2dfe8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:14.921229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 675/1357] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:15.226188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5b77f-b4ab-4287-8423-284a09d944b8 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:15.226540 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5b77f-b4ab-4287-8423-284a09d944b8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:15.227020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5b77f-b4ab-4287-8423-284a09d944b8 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:15.230002 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 683/1358] 10.222.0.23 () {54 vars in 961 bytes} [Tue Oct 4 08:27:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:15.239775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da10093-74fc-499e-bc41-2f9ffc3d6965 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:15.240271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da10093-74fc-499e-bc41-2f9ffc3d6965 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:15.240819 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da10093-74fc-499e-bc41-2f9ffc3d6965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:15.332018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5da10093-74fc-499e-bc41-2f9ffc3d6965 None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:15.333425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5da10093-74fc-499e-bc41-2f9ffc3d6965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:15.396986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:15.472488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 676/1359] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Oct 4 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:15.480412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5b77f-b4ab-4287-8423-284a09d944b8 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:15.482401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-16b5b77f-b4ab-4287-8423-284a09d944b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:15.637427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5b77f-b4ab-4287-8423-284a09d944b8 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:15.712204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:15.754635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe888c49-9a29-4b6d-bbff-891d01daa88e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:15.755271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888c49-9a29-4b6d-bbff-891d01daa88e service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:15.755476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888c49-9a29-4b6d-bbff-891d01daa88e service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:15.755830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888c49-9a29-4b6d-bbff-891d01daa88e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:15.757459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fe888c49-9a29-4b6d-bbff-891d01daa88e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:15.861138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe888c49-9a29-4b6d-bbff-891d01daa88e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:15.863943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe888c49-9a29-4b6d-bbff-891d01daa88e service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:15.883777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 684/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:27:18.304876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114c1e-7f35-49c0-9b86-22b7f3ffd42f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:18.305330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114c1e-7f35-49c0-9b86-22b7f3ffd42f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:18.305330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114c1e-7f35-49c0-9b86-22b7f3ffd42f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:18.312005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 677/1361] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:18.313259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aaa2b-a11d-4506-af4f-f5dde7f64197 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:18.313259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aaa2b-a11d-4506-af4f-f5dde7f64197 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:18.313259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aaa2b-a11d-4506-af4f-f5dde7f64197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:18.403551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4f2aaa2b-a11d-4506-af4f-f5dde7f64197 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:18.405116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4f2aaa2b-a11d-4506-af4f-f5dde7f64197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:18.450060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:18.520108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 685/1362] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:27:18.811764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e114c1e-7f35-49c0-9b86-22b7f3ffd42f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:18.813263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7e114c1e-7f35-49c0-9b86-22b7f3ffd42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:18.990573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e114c1e-7f35-49c0-9b86-22b7f3ffd42f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:19.002405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:19.129113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7867c2-a782-4288-a1a8-d618803028ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:19.129715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7867c2-a782-4288-a1a8-d618803028ea service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:19.130400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7867c2-a782-4288-a1a8-d618803028ea service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:19.130400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7867c2-a782-4288-a1a8-d618803028ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:19.131873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4a7867c2-a782-4288-a1a8-d618803028ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:19.224937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7867c2-a782-4288-a1a8-d618803028ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:19.226547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7867c2-a782-4288-a1a8-d618803028ea service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:19.245549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 678/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:27:21.759444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a191e-56b6-430a-8d22-86c76863a4a3 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:21.760041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a191e-56b6-430a-8d22-86c76863a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:21.760041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a191e-56b6-430a-8d22-86c76863a4a3 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:21.761516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 686/1364] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:21.767383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ac8b-490a-43b6-ad8d-fd8287ec67ce None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:21.767834 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ac8b-490a-43b6-ad8d-fd8287ec67ce None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:21.767949 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ac8b-490a-43b6-ad8d-fd8287ec67ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:21.783998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:21.838848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7080ac8b-490a-43b6-ad8d-fd8287ec67ce None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:21.840080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7080ac8b-490a-43b6-ad8d-fd8287ec67ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:21.943130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 679/1365] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:27:22.242427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac827-f622-4fd6-b78d-0a70425c3670 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:22.242738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac827-f622-4fd6-b78d-0a70425c3670 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:22.243215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac827-f622-4fd6-b78d-0a70425c3670 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:22.244559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 687/1366] 10.222.0.23 () {54 vars in 961 bytes} [Tue Oct 4 08:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:22.250930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be2d52-d631-42f9-864d-63a9d97b5aa7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:22.251361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be2d52-d631-42f9-864d-63a9d97b5aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:22.251731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be2d52-d631-42f9-864d-63a9d97b5aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:22.333203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-63be2d52-d631-42f9-864d-63a9d97b5aa7 None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:22.334569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-63be2d52-d631-42f9-864d-63a9d97b5aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:22.369735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:22.460498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 680/1367] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Oct 4 08:27:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:22.471894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ac827-f622-4fd6-b78d-0a70425c3670 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:22.474344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ca4ac827-f622-4fd6-b78d-0a70425c3670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:22.637196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ac827-f622-4fd6-b78d-0a70425c3670 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:22.659141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:22.759960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba24cb-925d-40e1-8837-c53222dfec18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:22.760781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba24cb-925d-40e1-8837-c53222dfec18 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:22.760975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba24cb-925d-40e1-8837-c53222dfec18 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:22.761247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba24cb-925d-40e1-8837-c53222dfec18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:22.762902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-74ba24cb-925d-40e1-8837-c53222dfec18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:22.856009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba24cb-925d-40e1-8837-c53222dfec18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:22.858234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba24cb-925d-40e1-8837-c53222dfec18 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:22.877137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 688/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:27:23.046559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616cc14-a704-469f-bc89-b23d458f2801 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:23.047203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616cc14-a704-469f-bc89-b23d458f2801 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:23.047203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616cc14-a704-469f-bc89-b23d458f2801 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:23.048764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 681/1369] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:23.054848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009df599-ff7e-473a-9854-fc9aa48da2f5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:23.055204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009df599-ff7e-473a-9854-fc9aa48da2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:23.055411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009df599-ff7e-473a-9854-fc9aa48da2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:23.092026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:23.137377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-009df599-ff7e-473a-9854-fc9aa48da2f5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:23.139999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-009df599-ff7e-473a-9854-fc9aa48da2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:23.254483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 689/1370] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:23.595395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550de9-963b-4969-a81f-cdcc2290049d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:23.595683 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550de9-963b-4969-a81f-cdcc2290049d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:23.595960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550de9-963b-4969-a81f-cdcc2290049d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:23.597420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 682/1371] 10.222.0.23 () {54 vars in 963 bytes} [Tue Oct 4 08:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:23.602299 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e4f79-affa-4f7e-ba82-ac855c4e1d0d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:23.602591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e4f79-affa-4f7e-ba82-ac855c4e1d0d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:23.602901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e4f79-affa-4f7e-ba82-ac855c4e1d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:23.683602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6d1e4f79-affa-4f7e-ba82-ac855c4e1d0d None None] MFA Rules not processed for user `53db39d8c5d1459294b0376d052a9495`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:23.684668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6d1e4f79-affa-4f7e-ba82-ac855c4e1d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:23.735437 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:23.768097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 690/1372] 10.222.0.23 () {58 vars in 1060 bytes} [Tue Oct 4 08:27:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:23.775694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1550de9-963b-4969-a81f-cdcc2290049d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:23.777380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d1550de9-963b-4969-a81f-cdcc2290049d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:23.914304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1550de9-963b-4969-a81f-cdcc2290049d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:23.962440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:24.000766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806b371-a55f-49c5-bb75-71d27e80b588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:24.001469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b371-a55f-49c5-bb75-71d27e80b588 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:24.001625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b371-a55f-49c5-bb75-71d27e80b588 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:24.001926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b371-a55f-49c5-bb75-71d27e80b588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:24.003477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c806b371-a55f-49c5-bb75-71d27e80b588 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:24.118803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806b371-a55f-49c5-bb75-71d27e80b588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:24.120259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806b371-a55f-49c5-bb75-71d27e80b588 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:24.140009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 683/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:27:25.158164 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288276-fb67-49bb-acf3-4b005b6e451a None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:25.158713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288276-fb67-49bb-acf3-4b005b6e451a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:25.158713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288276-fb67-49bb-acf3-4b005b6e451a None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:25.160238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 691/1374] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:25.166266 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0dfa0-1652-405c-8d80-96d7c541cc7f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:25.166872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0dfa0-1652-405c-8d80-96d7c541cc7f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:25.166872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0dfa0-1652-405c-8d80-96d7c541cc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:25.233157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-71b0dfa0-1652-405c-8d80-96d7c541cc7f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:25.234376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-71b0dfa0-1652-405c-8d80-96d7c541cc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:25.255714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:25.331767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 684/1375] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:27:25.620459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288276-fb67-49bb-acf3-4b005b6e451a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:25.622013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ef288276-fb67-49bb-acf3-4b005b6e451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:25.786304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288276-fb67-49bb-acf3-4b005b6e451a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:25.843009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:25.909827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab565ab-faa5-4081-b790-1f957635adb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:25.910434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab565ab-faa5-4081-b790-1f957635adb1 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:25.910736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab565ab-faa5-4081-b790-1f957635adb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:25.911011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab565ab-faa5-4081-b790-1f957635adb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:25.912608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2ab565ab-faa5-4081-b790-1f957635adb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:26.007455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab565ab-faa5-4081-b790-1f957635adb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:26.009163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab565ab-faa5-4081-b790-1f957635adb1 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:26.028325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 692/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:27:28.295249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b03ae-f5d4-4b36-abba-f4115a9f1a72 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:28.295806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b03ae-f5d4-4b36-abba-f4115a9f1a72 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:28.295806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b03ae-f5d4-4b36-abba-f4115a9f1a72 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:28.297320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 685/1377] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:28.302591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d49389-75d4-4062-ad67-eae3f8705575 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:28.303082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d49389-75d4-4062-ad67-eae3f8705575 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:28.303249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d49389-75d4-4062-ad67-eae3f8705575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:28.402534 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-77d49389-75d4-4062-ad67-eae3f8705575 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:28.404059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-77d49389-75d4-4062-ad67-eae3f8705575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:28.413337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:28.527969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 693/1378] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:28.823071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b03ae-f5d4-4b36-abba-f4115a9f1a72 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:28.824759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f31b03ae-f5d4-4b36-abba-f4115a9f1a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:28.977522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b03ae-f5d4-4b36-abba-f4115a9f1a72 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:28.981731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:29.099441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6e48a-122e-4145-b55e-b1ffd1616ceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:29.100118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6e48a-122e-4145-b55e-b1ffd1616ceb service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:29.100548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6e48a-122e-4145-b55e-b1ffd1616ceb service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:29.100927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6e48a-122e-4145-b55e-b1ffd1616ceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:29.102605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e6c6e48a-122e-4145-b55e-b1ffd1616ceb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:29.202076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6e48a-122e-4145-b55e-b1ffd1616ceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:29.203898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6e48a-122e-4145-b55e-b1ffd1616ceb service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:29.223282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 686/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:27:31.456483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a11d-eac1-4e74-9347-d18797d33ab2 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:31.457024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a11d-eac1-4e74-9347-d18797d33ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:31.457024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a11d-eac1-4e74-9347-d18797d33ab2 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:31.462010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 694/1380] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:31.463692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327da3-d929-442a-9067-994d620c9f9a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:31.464095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327da3-d929-442a-9067-994d620c9f9a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:31.468152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327da3-d929-442a-9067-994d620c9f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:31.476710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:31.539169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-38327da3-d929-442a-9067-994d620c9f9a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:31.540478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-38327da3-d929-442a-9067-994d620c9f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:31.650861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 687/1381] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:27:31.944299 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605a11d-eac1-4e74-9347-d18797d33ab2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:31.945839 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a605a11d-eac1-4e74-9347-d18797d33ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:32.092697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:32.103345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605a11d-eac1-4e74-9347-d18797d33ab2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:32.232655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dbc0b-bd9f-4db7-bb9a-70ca60a42595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:32.233400 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dbc0b-bd9f-4db7-bb9a-70ca60a42595 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:32.233789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dbc0b-bd9f-4db7-bb9a-70ca60a42595 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:32.234135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dbc0b-bd9f-4db7-bb9a-70ca60a42595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:32.236226 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7d2dbc0b-bd9f-4db7-bb9a-70ca60a42595 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:32.338926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dbc0b-bd9f-4db7-bb9a-70ca60a42595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:32.340770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dbc0b-bd9f-4db7-bb9a-70ca60a42595 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:32.352329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:32.362795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 695/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:27:34.626704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f177be8-450a-4e0b-8a4b-2033302b9f12 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:34.627230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f177be8-450a-4e0b-8a4b-2033302b9f12 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:34.627694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f177be8-450a-4e0b-8a4b-2033302b9f12 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:34.630616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 688/1383] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:34.636068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce44611-f88d-4309-826a-a1e89f4189ad None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:34.636835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce44611-f88d-4309-826a-a1e89f4189ad None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:34.636835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce44611-f88d-4309-826a-a1e89f4189ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:34.710241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0ce44611-f88d-4309-826a-a1e89f4189ad None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:34.711568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0ce44611-f88d-4309-826a-a1e89f4189ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:34.821118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 696/1384] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:35.128763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f177be8-450a-4e0b-8a4b-2033302b9f12 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:35.130355 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1f177be8-450a-4e0b-8a4b-2033302b9f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:35.222342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:35.296039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f177be8-450a-4e0b-8a4b-2033302b9f12 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:35.445470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d620e4-6f7c-4755-ad4e-74569b79394d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:35.446076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d620e4-6f7c-4755-ad4e-74569b79394d service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:35.446356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d620e4-6f7c-4755-ad4e-74569b79394d service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:35.446626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d620e4-6f7c-4755-ad4e-74569b79394d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:35.448266 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-77d620e4-6f7c-4755-ad4e-74569b79394d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:35.512414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:35.560659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d620e4-6f7c-4755-ad4e-74569b79394d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:35.562858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d620e4-6f7c-4755-ad4e-74569b79394d service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:35.587220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 689/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:27:37.890949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8448-55e0-48ce-ab8e-e95a082231fe None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:37.891471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8448-55e0-48ce-ab8e-e95a082231fe None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:37.891471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8448-55e0-48ce-ab8e-e95a082231fe None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:37.892749 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 697/1386] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:37.898381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773e1a8-c20c-4127-8c32-c04a28661f59 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:37.898817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773e1a8-c20c-4127-8c32-c04a28661f59 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:37.899093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773e1a8-c20c-4127-8c32-c04a28661f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:37.966330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3773e1a8-c20c-4127-8c32-c04a28661f59 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:37.967575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3773e1a8-c20c-4127-8c32-c04a28661f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:38.068423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 690/1387] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:38.361008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b8448-55e0-48ce-ab8e-e95a082231fe None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:38.362630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ae8b8448-55e0-48ce-ab8e-e95a082231fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:38.443629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:38.519817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b8448-55e0-48ce-ab8e-e95a082231fe None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:38.635773 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c2c1e-3a4f-4221-a4ec-71cfdcb1afe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:38.636284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c2c1e-3a4f-4221-a4ec-71cfdcb1afe3 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:38.636558 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c2c1e-3a4f-4221-a4ec-71cfdcb1afe3 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:38.636824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c2c1e-3a4f-4221-a4ec-71cfdcb1afe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:38.638439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-720c2c1e-3a4f-4221-a4ec-71cfdcb1afe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:38.678424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:38.729024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c2c1e-3a4f-4221-a4ec-71cfdcb1afe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:38.730623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c2c1e-3a4f-4221-a4ec-71cfdcb1afe3 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:38.749640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 698/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:27:39.875781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76513dbe-f3aa-4c29-b2a1-aadf07499797 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:39.876298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76513dbe-f3aa-4c29-b2a1-aadf07499797 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:39.876298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76513dbe-f3aa-4c29-b2a1-aadf07499797 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:39.877750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 691/1389] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:39.883059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4e712-a0f2-42c4-8da4-9c6e8a111a71 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:39.883527 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4e712-a0f2-42c4-8da4-9c6e8a111a71 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:39.883623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4e712-a0f2-42c4-8da4-9c6e8a111a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:39.959952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-eaa4e712-a0f2-42c4-8da4-9c6e8a111a71 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:39.961188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-eaa4e712-a0f2-42c4-8da4-9c6e8a111a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:40.081974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 699/1390] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:27:40.421664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34be4b8-d9e1-4553-b4df-328c367969bb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:40.421944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34be4b8-d9e1-4553-b4df-328c367969bb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:40.422216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34be4b8-d9e1-4553-b4df-328c367969bb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:40.423591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 692/1391] 10.222.0.23 () {54 vars in 962 bytes} [Tue Oct 4 08:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:40.429564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631531a-4674-4305-b9f3-c681b9a7a881 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:40.429836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631531a-4674-4305-b9f3-c681b9a7a881 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:40.430110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631531a-4674-4305-b9f3-c681b9a7a881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:40.451809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:40.521153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5631531a-4674-4305-b9f3-c681b9a7a881 None None] MFA Rules not processed for user `7b2324f9166d4c2dac76f08b03991769`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:40.522351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5631531a-4674-4305-b9f3-c681b9a7a881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:40.599410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 700/1392] 10.222.0.23 () {58 vars in 1059 bytes} [Tue Oct 4 08:27:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:40.609383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34be4b8-d9e1-4553-b4df-328c367969bb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:40.610941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b34be4b8-d9e1-4553-b4df-328c367969bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:40.646169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:40.726066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34be4b8-d9e1-4553-b4df-328c367969bb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:40.801160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3411d97-ec13-4f36-9f4a-317ed8eade55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b2324f9166d4c2dac76f08b03991769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:40.801762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3411d97-ec13-4f36-9f4a-317ed8eade55 service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:40.802038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3411d97-ec13-4f36-9f4a-317ed8eade55 service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:40.802303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3411d97-ec13-4f36-9f4a-317ed8eade55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:40.803929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f3411d97-ec13-4f36-9f4a-317ed8eade55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:40.881594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:40.914551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3411d97-ec13-4f36-9f4a-317ed8eade55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:40.916212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3411d97-ec13-4f36-9f4a-317ed8eade55 service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:40.935507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 693/1393] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:27:41.047978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0602-540d-4a44-88c1-1aab7bf54ac8 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:41.048507 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0602-540d-4a44-88c1-1aab7bf54ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:41.048716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0602-540d-4a44-88c1-1aab7bf54ac8 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:41.050102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 701/1394] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:41.055482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e7a3-8313-4e51-b64c-0a575527ae74 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:41.055768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e7a3-8313-4e51-b64c-0a575527ae74 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:41.056038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e7a3-8313-4e51-b64c-0a575527ae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:41.124248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-57e0e7a3-8313-4e51-b64c-0a575527ae74 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:41.125534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-57e0e7a3-8313-4e51-b64c-0a575527ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:41.232066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 694/1395] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:41.527073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0602-540d-4a44-88c1-1aab7bf54ac8 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:41.529245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d06f0602-540d-4a44-88c1-1aab7bf54ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:41.635299 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:41.683663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0602-540d-4a44-88c1-1aab7bf54ac8 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:41.688636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3f5f-73a3-45c7-beca-0f8016418b7c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:41.689043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3f5f-73a3-45c7-beca-0f8016418b7c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:41.689383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3f5f-73a3-45c7-beca-0f8016418b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:41.743420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:41.766631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9b1e3f5f-73a3-45c7-beca-0f8016418b7c None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:41.767794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9b1e3f5f-73a3-45c7-beca-0f8016418b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:41.801950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dd265-0965-43ad-bf75-965c82734c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:41.802563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dd265-0965-43ad-bf75-965c82734c47 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:41.802866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dd265-0965-43ad-bf75-965c82734c47 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:41.803136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dd265-0965-43ad-bf75-965c82734c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:41.804732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-345dd265-0965-43ad-bf75-965c82734c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:41.853762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 695/1396] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:27:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:27:41.878089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:41.898779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dd265-0965-43ad-bf75-965c82734c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:41.900387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dd265-0965-43ad-bf75-965c82734c47 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:41.902393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a1309-ec77-4130-8f24-f41d071298bd None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:41.902874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a1309-ec77-4130-8f24-f41d071298bd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:41.902983 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a1309-ec77-4130-8f24-f41d071298bd None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:41.904399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 696/1397] 10.222.0.23 () {54 vars in 943 bytes} [Tue Oct 4 08:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:27:41.910477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9eea9-ea8e-46e0-a275-e37b328b0a77 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:41.910796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9eea9-ea8e-46e0-a275-e37b328b0a77 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:41.911069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9eea9-ea8e-46e0-a275-e37b328b0a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:41.919132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 702/1398] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:27:41.999533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6cc9eea9-ea8e-46e0-a275-e37b328b0a77 None None] MFA Rules not processed for user `ce739a6448604eae823fd285a0164b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:42.000818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6cc9eea9-ea8e-46e0-a275-e37b328b0a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:42.081976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:42.134268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 697/1399] 10.222.0.23 () {58 vars in 1040 bytes} [Tue Oct 4 08:27:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:27:42.144694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dd265-0965-43ad-bf75-965c82734c47 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:42.146568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-345dd265-0965-43ad-bf75-965c82734c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:42.261917 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dd265-0965-43ad-bf75-965c82734c47 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:42.362739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:42.364186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bae1f2-dbe1-4579-8ff8-eefb0bcd6824 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:42.365035 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bae1f2-dbe1-4579-8ff8-eefb0bcd6824 service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:42.365405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bae1f2-dbe1-4579-8ff8-eefb0bcd6824 service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:42.365876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bae1f2-dbe1-4579-8ff8-eefb0bcd6824 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:42.367875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-47bae1f2-dbe1-4579-8ff8-eefb0bcd6824 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:42.453059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bae1f2-dbe1-4579-8ff8-eefb0bcd6824 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:42.454845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bae1f2-dbe1-4579-8ff8-eefb0bcd6824 service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:42.463182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 703/1400] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:27:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:27:44.152349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f55ca-cf18-4ffd-9dab-2d297dcbc714 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:44.153279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f55ca-cf18-4ffd-9dab-2d297dcbc714 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:44.153713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f55ca-cf18-4ffd-9dab-2d297dcbc714 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:44.156040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 698/1401] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:44.161811 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadef5be-881e-4b8f-a43d-bccb6475d5dd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:44.162351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadef5be-881e-4b8f-a43d-bccb6475d5dd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:44.162351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadef5be-881e-4b8f-a43d-bccb6475d5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:44.243414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-aadef5be-881e-4b8f-a43d-bccb6475d5dd None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:44.244906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-aadef5be-881e-4b8f-a43d-bccb6475d5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:44.351961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:44.360532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 704/1402] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:27:44.655106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f55ca-cf18-4ffd-9dab-2d297dcbc714 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:44.656632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea1f55ca-cf18-4ffd-9dab-2d297dcbc714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:44.827559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f55ca-cf18-4ffd-9dab-2d297dcbc714 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:44.871384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:44.952680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7efc8d-cfb4-4489-81bb-580b5a635e3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:44.953441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7efc8d-cfb4-4489-81bb-580b5a635e3c service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:44.953796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7efc8d-cfb4-4489-81bb-580b5a635e3c service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:44.954136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7efc8d-cfb4-4489-81bb-580b5a635e3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:44.955790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ca7efc8d-cfb4-4489-81bb-580b5a635e3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:45.052654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7efc8d-cfb4-4489-81bb-580b5a635e3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:45.054294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7efc8d-cfb4-4489-81bb-580b5a635e3c service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:45.076039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 699/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:27:47.471830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173dc5-6824-4fe7-827f-e162dc1bdf5b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:47.472305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173dc5-6824-4fe7-827f-e162dc1bdf5b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:47.472403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173dc5-6824-4fe7-827f-e162dc1bdf5b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:47.473872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 705/1404] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:47.479291 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d0e79-2ec7-4f78-9bd7-aa96986172df None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:47.480253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d0e79-2ec7-4f78-9bd7-aa96986172df None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:47.480536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d0e79-2ec7-4f78-9bd7-aa96986172df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:47.551774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:47.561658 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-341d0e79-2ec7-4f78-9bd7-aa96986172df None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:47.563248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-341d0e79-2ec7-4f78-9bd7-aa96986172df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:47.672249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 700/1405] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:27:47.961884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43173dc5-6824-4fe7-827f-e162dc1bdf5b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:47.963525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-43173dc5-6824-4fe7-827f-e162dc1bdf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:48.130011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43173dc5-6824-4fe7-827f-e162dc1bdf5b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:48.205830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:48.257031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a1278-5239-4a44-8c6d-f0cbd99d9de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:48.258032 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1278-5239-4a44-8c6d-f0cbd99d9de5 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:48.258579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1278-5239-4a44-8c6d-f0cbd99d9de5 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:48.259046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1278-5239-4a44-8c6d-f0cbd99d9de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:48.260888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-744a1278-5239-4a44-8c6d-f0cbd99d9de5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:48.358694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a1278-5239-4a44-8c6d-f0cbd99d9de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:48.360297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a1278-5239-4a44-8c6d-f0cbd99d9de5 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:48.378978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 706/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:27:50.656338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191139f-8b5b-47bb-a002-85b8c31b0002 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:50.656338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191139f-8b5b-47bb-a002-85b8c31b0002 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:50.656338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191139f-8b5b-47bb-a002-85b8c31b0002 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:50.661788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 701/1407] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:27:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:27:50.663174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd4fc-73ef-4896-b316-b23a2ff12f15 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:50.663568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd4fc-73ef-4896-b316-b23a2ff12f15 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:50.663728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd4fc-73ef-4896-b316-b23a2ff12f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:50.742996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-94dbd4fc-73ef-4896-b316-b23a2ff12f15 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:27:50.744138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-94dbd4fc-73ef-4896-b316-b23a2ff12f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:50.783275 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:50.876026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 707/1408] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:27:51.171167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191139f-8b5b-47bb-a002-85b8c31b0002 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:27:51.172894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d191139f-8b5b-47bb-a002-85b8c31b0002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:51.309766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:51.343641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191139f-8b5b-47bb-a002-85b8c31b0002 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:27:51.467722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25391c4-74b8-4548-a441-d93254b7a796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:27:51.468537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25391c4-74b8-4548-a441-d93254b7a796 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:27:51.468898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25391c4-74b8-4548-a441-d93254b7a796 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:27:51.469232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25391c4-74b8-4548-a441-d93254b7a796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:27:51.471206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e25391c4-74b8-4548-a441-d93254b7a796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:27:51.571004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:27:51.575913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25391c4-74b8-4548-a441-d93254b7a796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:27:51.577708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25391c4-74b8-4548-a441-d93254b7a796 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:27:51.598780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 702/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:28:00.874296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=30 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:01.596332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:05.093715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb42bd-3b33-4386-a0dd-1e301ecb018a None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:05.094380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb42bd-3b33-4386-a0dd-1e301ecb018a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:05.094380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb42bd-3b33-4386-a0dd-1e301ecb018a None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:05.095784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 708/1410] 10.222.0.23 () {54 vars in 918 bytes} [Tue Oct 4 08:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:05.101090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456263a-52c3-4aea-9ab0-ab0092b3cdd0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:05.101492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456263a-52c3-4aea-9ab0-ab0092b3cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:05.101789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456263a-52c3-4aea-9ab0-ab0092b3cdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:05.176172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a456263a-52c3-4aea-9ab0-ab0092b3cdd0 None None] MFA Rules not processed for user `6a4030325cf0481ab634e253cfed9c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:05.177374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a456263a-52c3-4aea-9ab0-ab0092b3cdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:05.281592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 703/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Oct 4 08:28:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:05.296559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cf2aa-a512-4403-a189-64888a84f37b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:05.296853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cf2aa-a512-4403-a189-64888a84f37b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:05.297131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cf2aa-a512-4403-a189-64888a84f37b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:05.298496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 709/1412] 10.222.0.23 () {54 vars in 918 bytes} [Tue Oct 4 08:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:05.303446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70c79b-6327-4d4a-8841-062671d2d7a6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:05.303732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70c79b-6327-4d4a-8841-062671d2d7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:05.304008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70c79b-6327-4d4a-8841-062671d2d7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:05.377763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:05.380731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fd70c79b-6327-4d4a-8841-062671d2d7a6 None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:05.382478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fd70c79b-6327-4d4a-8841-062671d2d7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:05.495399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 704/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Oct 4 08:28:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:28:08.083034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f18d-b4dc-43df-b632-286db267f4c0 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:08.083579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f18d-b4dc-43df-b632-286db267f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:08.083579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f18d-b4dc-43df-b632-286db267f4c0 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:08.084927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:08.090174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4fa7b-6d04-492a-bd28-0c6b48b67828 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:08.090599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4fa7b-6d04-492a-bd28-0c6b48b67828 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:08.091260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4fa7b-6d04-492a-bd28-0c6b48b67828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:08.156475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ead4fa7b-6d04-492a-bd28-0c6b48b67828 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:08.157667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ead4fa7b-6d04-492a-bd28-0c6b48b67828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:08.211677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:08.252781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:08.543748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7f18d-b4dc-43df-b632-286db267f4c0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:08.546352 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-feb7f18d-b4dc-43df-b632-286db267f4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:08.693123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7f18d-b4dc-43df-b632-286db267f4c0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:08.769558 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:08.812117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84612b65-2c48-419d-9282-025373408ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:08.812718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612b65-2c48-419d-9282-025373408ef5 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:08.812994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612b65-2c48-419d-9282-025373408ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:08.813262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612b65-2c48-419d-9282-025373408ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:08.814869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-84612b65-2c48-419d-9282-025373408ef5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:08.907076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84612b65-2c48-419d-9282-025373408ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:08.908698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84612b65-2c48-419d-9282-025373408ef5 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:08.927118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 711/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:10.072913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277cfcd-1184-480b-8d79-c383df791e3e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:10.073459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277cfcd-1184-480b-8d79-c383df791e3e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:10.073459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277cfcd-1184-480b-8d79-c383df791e3e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:10.074882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:10.081645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9909f-5be5-4e6c-a72e-2d793e6ba296 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:10.082072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9909f-5be5-4e6c-a72e-2d793e6ba296 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:10.082190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9909f-5be5-4e6c-a72e-2d793e6ba296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:10.157400 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dbc9909f-5be5-4e6c-a72e-2d793e6ba296 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:10.158598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dbc9909f-5be5-4e6c-a72e-2d793e6ba296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:10.185375 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:10.254621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:10.408889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277cfcd-1184-480b-8d79-c383df791e3e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:10.410363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a277cfcd-1184-480b-8d79-c383df791e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:10.554861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277cfcd-1184-480b-8d79-c383df791e3e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:10.596170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:10.674030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454bded-a996-4473-96db-4d3f0ca2aa53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:10.674552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454bded-a996-4473-96db-4d3f0ca2aa53 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:10.674866 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454bded-a996-4473-96db-4d3f0ca2aa53 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:10.675134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454bded-a996-4473-96db-4d3f0ca2aa53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:10.676735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a454bded-a996-4473-96db-4d3f0ca2aa53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:10.767267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454bded-a996-4473-96db-4d3f0ca2aa53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:10.768853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454bded-a996-4473-96db-4d3f0ca2aa53 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:10.786307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 707/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:11.933949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be20064-f274-4f50-b5c7-282de3d8d9a1 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:11.934521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be20064-f274-4f50-b5c7-282de3d8d9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:11.934521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be20064-f274-4f50-b5c7-282de3d8d9a1 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:11.935884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:11.942341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563b070-345d-4925-baee-74c446c58120 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:11.942817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563b070-345d-4925-baee-74c446c58120 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:11.943094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563b070-345d-4925-baee-74c446c58120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:11.999102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:12.020182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0563b070-345d-4925-baee-74c446c58120 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:12.021379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0563b070-345d-4925-baee-74c446c58120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:12.116804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:12.268999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be20064-f274-4f50-b5c7-282de3d8d9a1 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:12.270445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0be20064-f274-4f50-b5c7-282de3d8d9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:12.413407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be20064-f274-4f50-b5c7-282de3d8d9a1 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:12.425961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:12.527037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264c7b0-723b-4d78-929c-4706f3e8458a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:12.527573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264c7b0-723b-4d78-929c-4706f3e8458a service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:12.527850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264c7b0-723b-4d78-929c-4706f3e8458a service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:12.528628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264c7b0-723b-4d78-929c-4706f3e8458a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:12.530297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d264c7b0-723b-4d78-929c-4706f3e8458a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:12.617170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264c7b0-723b-4d78-929c-4706f3e8458a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:12.618774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264c7b0-723b-4d78-929c-4706f3e8458a service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:12.636281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 714/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:13.753950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e106-b7ff-4aa3-98dc-51c541c9bd2b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:13.754466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e106-b7ff-4aa3-98dc-51c541c9bd2b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:13.754575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e106-b7ff-4aa3-98dc-51c541c9bd2b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:13.755851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:13.762089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3e0d-a7de-4391-9505-f6276da2dd83 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:13.762542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3e0d-a7de-4391-9505-f6276da2dd83 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:13.762662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3e0d-a7de-4391-9505-f6276da2dd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:13.782063 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:13.838158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4f4c3e0d-a7de-4391-9505-f6276da2dd83 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:13.839412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4f4c3e0d-a7de-4391-9505-f6276da2dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:13.937551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:14.090196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078e106-b7ff-4aa3-98dc-51c541c9bd2b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:14.092313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0078e106-b7ff-4aa3-98dc-51c541c9bd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:14.200708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:14.236835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078e106-b7ff-4aa3-98dc-51c541c9bd2b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:14.348161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4171-5291-4e2f-9272-3ccf3ba93ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:14.348682 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4171-5291-4e2f-9272-3ccf3ba93ecd service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:14.348956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4171-5291-4e2f-9272-3ccf3ba93ecd service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:14.349218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4171-5291-4e2f-9272-3ccf3ba93ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:14.350821 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a08d4171-5291-4e2f-9272-3ccf3ba93ecd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:14.427879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:14.441577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4171-5291-4e2f-9272-3ccf3ba93ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:14.443195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4171-5291-4e2f-9272-3ccf3ba93ecd service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:14.461218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 710/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:15.584034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656910a2-478f-432a-9381-86df14b81003 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:15.584598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656910a2-478f-432a-9381-86df14b81003 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:15.584598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656910a2-478f-432a-9381-86df14b81003 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:15.585952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:15.592625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d022-906f-4a7b-b40f-9b714f7fb86a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:15.593061 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d022-906f-4a7b-b40f-9b714f7fb86a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:15.593173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d022-906f-4a7b-b40f-9b714f7fb86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:15.667285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6769d022-906f-4a7b-b40f-9b714f7fb86a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:15.668487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6769d022-906f-4a7b-b40f-9b714f7fb86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:15.762174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:15.912034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656910a2-478f-432a-9381-86df14b81003 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:15.913542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-656910a2-478f-432a-9381-86df14b81003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:15.996012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:16.058735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656910a2-478f-432a-9381-86df14b81003 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:16.170645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543fc3-50df-40ba-9f94-4533fd777955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:16.171272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543fc3-50df-40ba-9f94-4533fd777955 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:16.171545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543fc3-50df-40ba-9f94-4533fd777955 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:16.171810 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543fc3-50df-40ba-9f94-4533fd777955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:16.173380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5e543fc3-50df-40ba-9f94-4533fd777955 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:16.220389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:16.261555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e543fc3-50df-40ba-9f94-4533fd777955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:16.263564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e543fc3-50df-40ba-9f94-4533fd777955 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:16.281580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 717/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:17.357260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66df2f-0f9a-4f1b-9abe-4bdcf017f1db None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:17.357832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66df2f-0f9a-4f1b-9abe-4bdcf017f1db None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:17.357832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66df2f-0f9a-4f1b-9abe-4bdcf017f1db None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:17.359206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:28:17.365603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e1d7b-a77c-458b-a5a0-aea64ea449e7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:17.366034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e1d7b-a77c-458b-a5a0-aea64ea449e7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:17.366138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e1d7b-a77c-458b-a5a0-aea64ea449e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:17.440683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2c6e1d7b-a77c-458b-a5a0-aea64ea449e7 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:17.441910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2c6e1d7b-a77c-458b-a5a0-aea64ea449e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:17.539590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:17.689842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66df2f-0f9a-4f1b-9abe-4bdcf017f1db None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:17.691382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8f66df2f-0f9a-4f1b-9abe-4bdcf017f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:17.739359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:17.836390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66df2f-0f9a-4f1b-9abe-4bdcf017f1db None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:17.947138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79027201-1f02-4344-a76f-28829212e0a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:17.947659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79027201-1f02-4344-a76f-28829212e0a1 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:17.947935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79027201-1f02-4344-a76f-28829212e0a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:17.948202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79027201-1f02-4344-a76f-28829212e0a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:17.949820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-79027201-1f02-4344-a76f-28829212e0a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:17.956801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:18.038035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79027201-1f02-4344-a76f-28829212e0a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:18.039650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79027201-1f02-4344-a76f-28829212e0a1 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:18.057847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 713/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:19.111467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7543-9aa3-4719-8b14-141ce4f4a5ee None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:19.112055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7543-9aa3-4719-8b14-141ce4f4a5ee None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:19.112055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7543-9aa3-4719-8b14-141ce4f4a5ee None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:19.113357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:19.119687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91661c39-7fb1-4990-bb3c-5afaa795300f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:19.120130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91661c39-7fb1-4990-bb3c-5afaa795300f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:19.120237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91661c39-7fb1-4990-bb3c-5afaa795300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:19.195449 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-91661c39-7fb1-4990-bb3c-5afaa795300f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:19.196653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-91661c39-7fb1-4990-bb3c-5afaa795300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:19.261855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:19.290276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:19.439306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e7543-9aa3-4719-8b14-141ce4f4a5ee None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:19.440818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ad4e7543-9aa3-4719-8b14-141ce4f4a5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:19.462425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:19.588021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e7543-9aa3-4719-8b14-141ce4f4a5ee None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:19.674120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:19.699058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5642c-8962-4532-946e-7e38fd3c9bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:19.699592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5642c-8962-4532-946e-7e38fd3c9bb4 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:19.700430 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5642c-8962-4532-946e-7e38fd3c9bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:19.700699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5642c-8962-4532-946e-7e38fd3c9bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:19.702285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f6d5642c-8962-4532-946e-7e38fd3c9bb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:19.792869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5642c-8962-4532-946e-7e38fd3c9bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:19.795039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5642c-8962-4532-946e-7e38fd3c9bb4 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:19.813259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 720/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:20.879308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d0910-2a9d-488c-bf17-294f91030c66 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:20.879854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d0910-2a9d-488c-bf17-294f91030c66 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:20.879854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d0910-2a9d-488c-bf17-294f91030c66 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:20.881110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:20.887562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e884a-1c5f-40cc-9dbb-b09ed8a50355 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:20.888010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e884a-1c5f-40cc-9dbb-b09ed8a50355 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:20.888478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e884a-1c5f-40cc-9dbb-b09ed8a50355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:20.965803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d42e884a-1c5f-40cc-9dbb-b09ed8a50355 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:20.967047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d42e884a-1c5f-40cc-9dbb-b09ed8a50355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:21.009636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:21.063934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:21.214303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d0910-2a9d-488c-bf17-294f91030c66 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:21.215907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-148d0910-2a9d-488c-bf17-294f91030c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:21.360368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d0910-2a9d-488c-bf17-294f91030c66 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:21.414144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:21.472868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1a369-32b0-4571-843e-32cc12535a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:21.473474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1a369-32b0-4571-843e-32cc12535a94 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:21.473752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1a369-32b0-4571-843e-32cc12535a94 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:21.474021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1a369-32b0-4571-843e-32cc12535a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:21.475654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dab1a369-32b0-4571-843e-32cc12535a94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:21.562685 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1a369-32b0-4571-843e-32cc12535a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:21.564294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1a369-32b0-4571-843e-32cc12535a94 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:21.582221 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 716/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:22.646404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd989cc-f2f4-4d57-a8db-75c6d9a883d6 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:22.646971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd989cc-f2f4-4d57-a8db-75c6d9a883d6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:22.646971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd989cc-f2f4-4d57-a8db-75c6d9a883d6 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:22.648310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:22.655564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bad145-8e03-4939-9daf-4d70e8efade3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:22.656018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bad145-8e03-4939-9daf-4d70e8efade3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:22.656120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bad145-8e03-4939-9daf-4d70e8efade3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:22.734912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-61bad145-8e03-4939-9daf-4d70e8efade3 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:22.736040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-61bad145-8e03-4939-9daf-4d70e8efade3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:22.738136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:22.830860 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:22.980068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd989cc-f2f4-4d57-a8db-75c6d9a883d6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:22.981945 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4cd989cc-f2f4-4d57-a8db-75c6d9a883d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:23.124654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd989cc-f2f4-4d57-a8db-75c6d9a883d6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:23.151877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:23.237581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7dc39-3b8a-4df5-8087-2b8f55cb5aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:23.238183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7dc39-3b8a-4df5-8087-2b8f55cb5aa3 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:23.238456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7dc39-3b8a-4df5-8087-2b8f55cb5aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:23.238748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7dc39-3b8a-4df5-8087-2b8f55cb5aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:23.240359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dda7dc39-3b8a-4df5-8087-2b8f55cb5aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:23.328174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7dc39-3b8a-4df5-8087-2b8f55cb5aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:23.329747 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7dc39-3b8a-4df5-8087-2b8f55cb5aa3 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:23.347413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 723/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:25.420665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5a6d7-4581-4e3d-9775-d5bb80cfa0fb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:25.421183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5a6d7-4581-4e3d-9775-d5bb80cfa0fb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:25.421183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5a6d7-4581-4e3d-9775-d5bb80cfa0fb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:25.422464 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:25.427833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8c735-2e3d-44b0-90ab-4705a0cbb072 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:25.428273 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8c735-2e3d-44b0-90ab-4705a0cbb072 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:25.428375 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8c735-2e3d-44b0-90ab-4705a0cbb072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:25.470282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:25.496056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-efb8c735-2e3d-44b0-90ab-4705a0cbb072 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:25.497780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-efb8c735-2e3d-44b0-90ab-4705a0cbb072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:25.592609 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:25.882184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5a6d7-4581-4e3d-9775-d5bb80cfa0fb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:25.883885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-24f5a6d7-4581-4e3d-9775-d5bb80cfa0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:25.986620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5a6d7-4581-4e3d-9775-d5bb80cfa0fb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:26.021585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:26.078628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d74519-4258-4e40-8b7c-4e088626c504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:26.079557 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d74519-4258-4e40-8b7c-4e088626c504 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:26.079984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d74519-4258-4e40-8b7c-4e088626c504 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:26.080399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d74519-4258-4e40-8b7c-4e088626c504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:26.082978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-73d74519-4258-4e40-8b7c-4e088626c504 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:26.197429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d74519-4258-4e40-8b7c-4e088626c504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:26.198890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d74519-4258-4e40-8b7c-4e088626c504 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:26.217082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 719/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:28.530571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defca9a-e976-4ccb-9615-14929a755ef5 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:28.531133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defca9a-e976-4ccb-9615-14929a755ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:28.531133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defca9a-e976-4ccb-9615-14929a755ef5 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:28.532478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:28.537848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e20ca4-c2fa-4884-819f-44a0adb1d21f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:28.538280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e20ca4-c2fa-4884-819f-44a0adb1d21f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:28.538387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e20ca4-c2fa-4884-819f-44a0adb1d21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:28.603683 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-97e20ca4-c2fa-4884-819f-44a0adb1d21f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:28.604874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-97e20ca4-c2fa-4884-819f-44a0adb1d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:28.617967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:28.700435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:28.985287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defca9a-e976-4ccb-9615-14929a755ef5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:28.986880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0defca9a-e976-4ccb-9615-14929a755ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:29.094363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defca9a-e976-4ccb-9615-14929a755ef5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:29.107816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:29.169918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45d405-9f88-465b-8d76-04c481a06530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:29.170562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45d405-9f88-465b-8d76-04c481a06530 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:29.170871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45d405-9f88-465b-8d76-04c481a06530 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:29.171143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45d405-9f88-465b-8d76-04c481a06530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:29.172752 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8d45d405-9f88-465b-8d76-04c481a06530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:29.280946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45d405-9f88-465b-8d76-04c481a06530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:29.282303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45d405-9f88-465b-8d76-04c481a06530 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:29.300193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 726/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:31.750482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e0cc9-8690-4e67-bc68-5df85c14b878 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:31.751041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e0cc9-8690-4e67-bc68-5df85c14b878 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:31.751041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e0cc9-8690-4e67-bc68-5df85c14b878 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:31.752356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:31.757636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efa09e-61e5-47cd-bc9f-1e290482ba27 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:31.758059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efa09e-61e5-47cd-bc9f-1e290482ba27 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:31.758173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efa09e-61e5-47cd-bc9f-1e290482ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:31.806158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:31.823743 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-11efa09e-61e5-47cd-bc9f-1e290482ba27 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:31.825555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-11efa09e-61e5-47cd-bc9f-1e290482ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:31.918946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:32.202901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e0cc9-8690-4e67-bc68-5df85c14b878 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:32.204459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c35e0cc9-8690-4e67-bc68-5df85c14b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:32.310650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e0cc9-8690-4e67-bc68-5df85c14b878 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:32.351619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:32.387720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e8073-214d-4e58-bd4d-ad9f156b4e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:32.388423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e8073-214d-4e58-bd4d-ad9f156b4e78 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:32.388708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e8073-214d-4e58-bd4d-ad9f156b4e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:32.388975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e8073-214d-4e58-bd4d-ad9f156b4e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:32.390566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d23e8073-214d-4e58-bd4d-ad9f156b4e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:32.500547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e8073-214d-4e58-bd4d-ad9f156b4e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:32.501985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e8073-214d-4e58-bd4d-ad9f156b4e78 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:32.519779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 722/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:34.798261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9675a6-782b-41c1-b863-46b980da16e0 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:34.798801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9675a6-782b-41c1-b863-46b980da16e0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:34.798801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9675a6-782b-41c1-b863-46b980da16e0 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:34.800109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:34.805391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ebd6-e1bd-4569-bb2b-1d0c0ae5fa9e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:34.805819 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ebd6-e1bd-4569-bb2b-1d0c0ae5fa9e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:34.805949 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ebd6-e1bd-4569-bb2b-1d0c0ae5fa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:34.870503 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ee88ebd6-e1bd-4569-bb2b-1d0c0ae5fa9e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:34.871800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ee88ebd6-e1bd-4569-bb2b-1d0c0ae5fa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:34.892136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:34.969660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:35.258876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9675a6-782b-41c1-b863-46b980da16e0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:35.260440 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2d9675a6-782b-41c1-b863-46b980da16e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:35.362627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9675a6-782b-41c1-b863-46b980da16e0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:35.383556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:35.436214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55c878-b95b-4319-8a2c-f49d0d5b6c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:35.436807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c878-b95b-4319-8a2c-f49d0d5b6c72 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:35.437082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c878-b95b-4319-8a2c-f49d0d5b6c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:35.437349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c878-b95b-4319-8a2c-f49d0d5b6c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:35.438962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8e55c878-b95b-4319-8a2c-f49d0d5b6c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:35.552625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55c878-b95b-4319-8a2c-f49d0d5b6c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:35.553981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55c878-b95b-4319-8a2c-f49d0d5b6c72 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:35.572592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 729/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:37.792299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb206f-3421-4f4b-98d1-0d67362f2976 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:37.793359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb206f-3421-4f4b-98d1-0d67362f2976 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:37.793359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb206f-3421-4f4b-98d1-0d67362f2976 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:37.794703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:37.800140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ab57e-03e4-4e30-a160-f9f6d6cd8cab None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:37.800569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ab57e-03e4-4e30-a160-f9f6d6cd8cab None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:37.800679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ab57e-03e4-4e30-a160-f9f6d6cd8cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:37.869676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:37.873204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-da7ab57e-03e4-4e30-a160-f9f6d6cd8cab None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:37.874965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-da7ab57e-03e4-4e30-a160-f9f6d6cd8cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:37.968658 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:38.260208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb206f-3421-4f4b-98d1-0d67362f2976 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:38.261747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-45cb206f-3421-4f4b-98d1-0d67362f2976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:38.363871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb206f-3421-4f4b-98d1-0d67362f2976 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:38.414023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:38.438443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bd647-0fec-4654-96c3-9a3d8476179b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:38.439064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bd647-0fec-4654-96c3-9a3d8476179b service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:38.439339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bd647-0fec-4654-96c3-9a3d8476179b service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:38.439602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bd647-0fec-4654-96c3-9a3d8476179b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:38.441179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fd2bd647-0fec-4654-96c3-9a3d8476179b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:38.552288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bd647-0fec-4654-96c3-9a3d8476179b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:38.553735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bd647-0fec-4654-96c3-9a3d8476179b service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:38.571750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 725/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:40.837282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad87c2b-dd79-46ac-bbfa-8ed068c72b3a None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:40.837818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad87c2b-dd79-46ac-bbfa-8ed068c72b3a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:40.837818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad87c2b-dd79-46ac-bbfa-8ed068c72b3a None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:40.839246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:40.844997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f17e5d-e5c3-41f8-9d98-65cb0531a91c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:40.845483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f17e5d-e5c3-41f8-9d98-65cb0531a91c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:40.845575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f17e5d-e5c3-41f8-9d98-65cb0531a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:40.924500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a8f17e5d-e5c3-41f8-9d98-65cb0531a91c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:40.927828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a8f17e5d-e5c3-41f8-9d98-65cb0531a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:40.964417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:41.052395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:41.362290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad87c2b-dd79-46ac-bbfa-8ed068c72b3a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:41.363867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-aad87c2b-dd79-46ac-bbfa-8ed068c72b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:41.482649 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad87c2b-dd79-46ac-bbfa-8ed068c72b3a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:41.511898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:41.556308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3b6db-0ed9-4b29-9114-f934f016910e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:41.556902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b6db-0ed9-4b29-9114-f934f016910e service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:41.557176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b6db-0ed9-4b29-9114-f934f016910e service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:41.557441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b6db-0ed9-4b29-9114-f934f016910e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:41.559169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d8a3b6db-0ed9-4b29-9114-f934f016910e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:41.665709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3b6db-0ed9-4b29-9114-f934f016910e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:41.667389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3b6db-0ed9-4b29-9114-f934f016910e service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:41.685551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 732/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:43.892850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f40773-d48c-4136-8084-be6678678150 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:43.893495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f40773-d48c-4136-8084-be6678678150 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:43.893495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f40773-d48c-4136-8084-be6678678150 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:43.894939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:43.900065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170ef94-9bf9-4dba-98b8-edee362dc91c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:43.900509 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170ef94-9bf9-4dba-98b8-edee362dc91c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:43.900616 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170ef94-9bf9-4dba-98b8-edee362dc91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:43.966400 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7170ef94-9bf9-4dba-98b8-edee362dc91c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:43.967625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7170ef94-9bf9-4dba-98b8-edee362dc91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:43.975702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:44.064432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:44.353538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f40773-d48c-4136-8084-be6678678150 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:44.355684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-86f40773-d48c-4136-8084-be6678678150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:44.461562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f40773-d48c-4136-8084-be6678678150 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:44.517962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:44.536018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb4e00-c2bd-47bd-9a42-01c8229cc39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:44.536622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb4e00-c2bd-47bd-9a42-01c8229cc39e service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:44.536905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb4e00-c2bd-47bd-9a42-01c8229cc39e service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:44.537174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb4e00-c2bd-47bd-9a42-01c8229cc39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:44.538803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-25fb4e00-c2bd-47bd-9a42-01c8229cc39e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:44.646354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb4e00-c2bd-47bd-9a42-01c8229cc39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:44.647769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb4e00-c2bd-47bd-9a42-01c8229cc39e service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:44.665287 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 728/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:46.870411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e018f6-10be-4c39-8dcd-d519bc1e67f6 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:46.871039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e018f6-10be-4c39-8dcd-d519bc1e67f6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:46.871169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e018f6-10be-4c39-8dcd-d519bc1e67f6 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:46.872474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:46.877866 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08114954-290f-44ac-8869-3803fdec720d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:46.878337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08114954-290f-44ac-8869-3803fdec720d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:46.878443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08114954-290f-44ac-8869-3803fdec720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:46.946405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-08114954-290f-44ac-8869-3803fdec720d None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:46.947647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-08114954-290f-44ac-8869-3803fdec720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:46.985701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:47.044585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:47.330974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e018f6-10be-4c39-8dcd-d519bc1e67f6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:47.332557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b2e018f6-10be-4c39-8dcd-d519bc1e67f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:47.437835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e018f6-10be-4c39-8dcd-d519bc1e67f6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:47.477691 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:47.516149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e4e69-e555-4200-a6ef-4309553ff808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:47.516758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e4e69-e555-4200-a6ef-4309553ff808 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:47.517037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e4e69-e555-4200-a6ef-4309553ff808 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:47.517306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e4e69-e555-4200-a6ef-4309553ff808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:47.518946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-af8e4e69-e555-4200-a6ef-4309553ff808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:47.628742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e4e69-e555-4200-a6ef-4309553ff808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:47.630102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e4e69-e555-4200-a6ef-4309553ff808 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:47.648641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 735/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:49.815776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e85ff-6c53-413d-9c10-bb4e4fff09eb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:49.816307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e85ff-6c53-413d-9c10-bb4e4fff09eb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:49.816307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e85ff-6c53-413d-9c10-bb4e4fff09eb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:49.817580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:49.822809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca21bc-b10d-4901-83d6-5163c31b8667 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:49.823260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca21bc-b10d-4901-83d6-5163c31b8667 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:49.823378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca21bc-b10d-4901-83d6-5163c31b8667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:49.888079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c8ca21bc-b10d-4901-83d6-5163c31b8667 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:49.889300 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c8ca21bc-b10d-4901-83d6-5163c31b8667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:49.906780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:49.983895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:50.272463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e85ff-6c53-413d-9c10-bb4e4fff09eb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:50.274009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-722e85ff-6c53-413d-9c10-bb4e4fff09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:50.376138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e85ff-6c53-413d-9c10-bb4e4fff09eb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:50.443898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:50.451101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163b53d-6386-46a4-97d6-ed10567bdeb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:50.451716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b53d-6386-46a4-97d6-ed10567bdeb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:50.451999 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b53d-6386-46a4-97d6-ed10567bdeb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:50.452300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b53d-6386-46a4-97d6-ed10567bdeb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:50.453919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4163b53d-6386-46a4-97d6-ed10567bdeb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:50.568514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163b53d-6386-46a4-97d6-ed10567bdeb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:50.570760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163b53d-6386-46a4-97d6-ed10567bdeb8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:50.597366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 731/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:28:52.777247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b1e86-e44e-4db2-b6da-c421c98d2a87 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:52.777761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b1e86-e44e-4db2-b6da-c421c98d2a87 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:52.777761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b1e86-e44e-4db2-b6da-c421c98d2a87 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:52.779121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:28:52.784528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04db9-a883-4e7f-9a80-f1d891289bf0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:52.784979 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04db9-a883-4e7f-9a80-f1d891289bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:52.785089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04db9-a883-4e7f-9a80-f1d891289bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:52.850451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-45a04db9-a883-4e7f-9a80-f1d891289bf0 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:28:52.851705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-45a04db9-a883-4e7f-9a80-f1d891289bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:52.898540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:52.947478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:28:53.241789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b1e86-e44e-4db2-b6da-c421c98d2a87 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:28:53.243373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-710b1e86-e44e-4db2-b6da-c421c98d2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:53.352459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b1e86-e44e-4db2-b6da-c421c98d2a87 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:28:53.399836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:28:53.426113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209d05-83dd-44b5-a60e-fa5560381c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:28:53.426733 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209d05-83dd-44b5-a60e-fa5560381c0f service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:28:53.427015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209d05-83dd-44b5-a60e-fa5560381c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:28:53.427283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209d05-83dd-44b5-a60e-fa5560381c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:28:53.428860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-02209d05-83dd-44b5-a60e-fa5560381c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:28:53.540391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02209d05-83dd-44b5-a60e-fa5560381c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:28:53.542045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02209d05-83dd-44b5-a60e-fa5560381c0f service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:28:53.560088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 738/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:29:02.945982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=22 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:03.558178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=66 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:13.503945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca0bb-8de4-4f0d-a866-34afe6e9b7fe None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:13.504497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca0bb-8de4-4f0d-a866-34afe6e9b7fe None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:13.504596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca0bb-8de4-4f0d-a866-34afe6e9b7fe None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:13.505873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 733/1471] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:29:13.511273 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b777232-6b48-4fa9-9fb1-e404856375d5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:13.511692 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b777232-6b48-4fa9-9fb1-e404856375d5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:13.511821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b777232-6b48-4fa9-9fb1-e404856375d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:13.576079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7b777232-6b48-4fa9-9fb1-e404856375d5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:29:13.577267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7b777232-6b48-4fa9-9fb1-e404856375d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:13.672279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 739/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:29:13.970710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ce242-e11e-4538-aead-ef639810b261 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:13.971000 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ce242-e11e-4538-aead-ef639810b261 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:13.971277 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ce242-e11e-4538-aead-ef639810b261 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:13.972632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 734/1473] 10.222.0.23 () {54 vars in 962 bytes} [Tue Oct 4 08:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:29:13.977427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060ee9-7bba-449e-b24c-e30f13c970fb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:13.977710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060ee9-7bba-449e-b24c-e30f13c970fb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:13.977982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060ee9-7bba-449e-b24c-e30f13c970fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:14.053032 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b8060ee9-7bba-449e-b24c-e30f13c970fb None None] MFA Rules not processed for user `7b2324f9166d4c2dac76f08b03991769`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:29:14.054162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b8060ee9-7bba-449e-b24c-e30f13c970fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:14.076806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:14.133015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 740/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Tue Oct 4 08:29:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:29:14.141468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ce242-e11e-4538-aead-ef639810b261 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:29:14.143039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-307ce242-e11e-4538-aead-ef639810b261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:14.244914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ce242-e11e-4538-aead-ef639810b261 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:29:14.316281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e048678-f60f-477f-af8b-b141b9c29636 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b2324f9166d4c2dac76f08b03991769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:29:14.316803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e048678-f60f-477f-af8b-b141b9c29636 service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:14.317077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e048678-f60f-477f-af8b-b141b9c29636 service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:14.317343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e048678-f60f-477f-af8b-b141b9c29636 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:14.319009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0e048678-f60f-477f-af8b-b141b9c29636 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:14.376261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:14.431587 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e048678-f60f-477f-af8b-b141b9c29636 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:29:14.433565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e048678-f60f-477f-af8b-b141b9c29636 service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:29:14.452299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 735/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:29:16.708603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e336535-fa59-4131-97aa-f2b6983319f9 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:16.709180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e336535-fa59-4131-97aa-f2b6983319f9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:16.709180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e336535-fa59-4131-97aa-f2b6983319f9 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:16.710496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 741/1476] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:29:16.716325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306336ef-182e-4e79-aa46-dcde4e729b91 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:16.716741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306336ef-182e-4e79-aa46-dcde4e729b91 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:16.716915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306336ef-182e-4e79-aa46-dcde4e729b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:16.785745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-306336ef-182e-4e79-aa46-dcde4e729b91 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:29:16.786986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-306336ef-182e-4e79-aa46-dcde4e729b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:16.884997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 736/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:29:17.163935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e336535-fa59-4131-97aa-f2b6983319f9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:29:17.165384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3e336535-fa59-4131-97aa-f2b6983319f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:17.289185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e336535-fa59-4131-97aa-f2b6983319f9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:29:17.338520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:17.384692 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd42e9-d44f-4d90-8764-f82f12070f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:29:17.385798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd42e9-d44f-4d90-8764-f82f12070f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:17.386056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd42e9-d44f-4d90-8764-f82f12070f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:17.386317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd42e9-d44f-4d90-8764-f82f12070f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:17.386978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd42e9-d44f-4d90-8764-f82f12070f84 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:29:17.388755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-c7fd42e9-d44f-4d90-8764-f82f12070f84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:29:17.388755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: warnings.warn(msg) Oct 04 08:29:17.388755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: Oct 04 08:29:17.389903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd42e9-d44f-4d90-8764-f82f12070f84 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:29:17.409034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 742/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Oct 4 08:29:17 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:29:19.574151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15c100-ad50-4dcf-aecf-d0934725a2d9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:19.574739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15c100-ad50-4dcf-aecf-d0934725a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:19.574739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15c100-ad50-4dcf-aecf-d0934725a2d9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:19.576169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 737/1479] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:29:19.581626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6604-db84-4030-a849-c177766dd03b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:19.582122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6604-db84-4030-a849-c177766dd03b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:19.582233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6604-db84-4030-a849-c177766dd03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:19.647003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d65d6604-db84-4030-a849-c177766dd03b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:29:19.648206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d65d6604-db84-4030-a849-c177766dd03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:19.743085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 743/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:29:20.036346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15c100-ad50-4dcf-aecf-d0934725a2d9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:29:20.037978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa15c100-ad50-4dcf-aecf-d0934725a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:20.049187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:20.185175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15c100-ad50-4dcf-aecf-d0934725a2d9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:29:20.263747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:20.296257 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b37f5f-1a8b-4c18-b03d-266c62cb025f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:29:20.296788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b37f5f-1a8b-4c18-b03d-266c62cb025f service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:20.297064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b37f5f-1a8b-4c18-b03d-266c62cb025f service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:20.297329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b37f5f-1a8b-4c18-b03d-266c62cb025f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:20.298951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d5b37f5f-1a8b-4c18-b03d-266c62cb025f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:20.387599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b37f5f-1a8b-4c18-b03d-266c62cb025f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:29:20.389203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b37f5f-1a8b-4c18-b03d-266c62cb025f service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:29:20.406508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 738/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:29:22.729487 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21578e-d8ce-4240-8f59-cbfef7129bf4 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:22.730095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21578e-d8ce-4240-8f59-cbfef7129bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:22.730217 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21578e-d8ce-4240-8f59-cbfef7129bf4 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:22.731713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 744/1482] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:29:22.737160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb01c1c-559e-48cf-9e4e-0356580e4568 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:22.737606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb01c1c-559e-48cf-9e4e-0356580e4568 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:22.737744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb01c1c-559e-48cf-9e4e-0356580e4568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:22.803923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-abb01c1c-559e-48cf-9e4e-0356580e4568 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:29:22.805129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-abb01c1c-559e-48cf-9e4e-0356580e4568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:22.850180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:22.899624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 739/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:29:23.188932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21578e-d8ce-4240-8f59-cbfef7129bf4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:29:23.190459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0c21578e-d8ce-4240-8f59-cbfef7129bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:23.214577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:23.294688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21578e-d8ce-4240-8f59-cbfef7129bf4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:29:23.367366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d76d9-baed-44f7-ab00-e12669c1d044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:29:23.367963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d76d9-baed-44f7-ab00-e12669c1d044 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:23.368244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d76d9-baed-44f7-ab00-e12669c1d044 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:23.368520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d76d9-baed-44f7-ab00-e12669c1d044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:23.370141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8e2d76d9-baed-44f7-ab00-e12669c1d044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:23.562433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:23.597503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d76d9-baed-44f7-ab00-e12669c1d044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:29:23.598978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d76d9-baed-44f7-ab00-e12669c1d044 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:29:23.617266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 745/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:29:25.841458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d94e77-b01b-4986-8828-b06c60df69f3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:25.842014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d94e77-b01b-4986-8828-b06c60df69f3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:25.842014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d94e77-b01b-4986-8828-b06c60df69f3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:25.843280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 740/1485] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:29:25.848599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4910d-d61f-49ec-878d-28d9350c55f2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:25.849015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4910d-d61f-49ec-878d-28d9350c55f2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:25.849125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4910d-d61f-49ec-878d-28d9350c55f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:25.917128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-beb4910d-d61f-49ec-878d-28d9350c55f2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:29:25.918347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-beb4910d-d61f-49ec-878d-28d9350c55f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:26.012981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 746/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:29:26.305595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d94e77-b01b-4986-8828-b06c60df69f3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:29:26.307754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-00d94e77-b01b-4986-8828-b06c60df69f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:26.414431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d94e77-b01b-4986-8828-b06c60df69f3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:29:26.489397 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:26.491235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d68b32-a90d-4763-8347-1ba971dd9ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:29:26.492043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d68b32-a90d-4763-8347-1ba971dd9ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:26.492378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d68b32-a90d-4763-8347-1ba971dd9ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:26.492857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d68b32-a90d-4763-8347-1ba971dd9ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:26.495478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-11d68b32-a90d-4763-8347-1ba971dd9ec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:26.602942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d68b32-a90d-4763-8347-1ba971dd9ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:29:26.604863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d68b32-a90d-4763-8347-1ba971dd9ec6 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:29:26.622587 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 741/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:29:28.974733 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179dc6a-d8b2-410f-bc17-1889fc8b5889 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:28.975286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179dc6a-d8b2-410f-bc17-1889fc8b5889 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:28.975286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179dc6a-d8b2-410f-bc17-1889fc8b5889 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:28.976637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 747/1488] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:29:28.982724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322e3c5-7ef2-44c7-91f0-ad922e894439 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:28.983166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322e3c5-7ef2-44c7-91f0-ad922e894439 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:28.983303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322e3c5-7ef2-44c7-91f0-ad922e894439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:29.048045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6322e3c5-7ef2-44c7-91f0-ad922e894439 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:29:29.049256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6322e3c5-7ef2-44c7-91f0-ad922e894439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:29.100391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:29.150781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 742/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:29:29.438774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179dc6a-d8b2-410f-bc17-1889fc8b5889 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:29:29.440333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d179dc6a-d8b2-410f-bc17-1889fc8b5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:29.477632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:29.546180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179dc6a-d8b2-410f-bc17-1889fc8b5889 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:29:29.618489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35ff49-9e48-454e-a3b6-f3b3b3e7fff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:29:29.619716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35ff49-9e48-454e-a3b6-f3b3b3e7fff4 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:29.619992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35ff49-9e48-454e-a3b6-f3b3b3e7fff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:29.620257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35ff49-9e48-454e-a3b6-f3b3b3e7fff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:29.621867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cd35ff49-9e48-454e-a3b6-f3b3b3e7fff4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:29.699475 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:29.727721 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35ff49-9e48-454e-a3b6-f3b3b3e7fff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:29:29.729723 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35ff49-9e48-454e-a3b6-f3b3b3e7fff4 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:29:29.747681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 748/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:29:32.106222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e02da-d049-44e4-b50d-722ffd407169 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:32.106820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e02da-d049-44e4-b50d-722ffd407169 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:32.106820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e02da-d049-44e4-b50d-722ffd407169 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:32.108147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 743/1491] 10.222.0.23 () {54 vars in 927 bytes} [Tue Oct 4 08:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:29:32.113360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76bfeb-0962-4de8-88d2-8f547906a0f8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:32.113783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76bfeb-0962-4de8-88d2-8f547906a0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:32.113906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76bfeb-0962-4de8-88d2-8f547906a0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:32.178797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fa76bfeb-0962-4de8-88d2-8f547906a0f8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:29:32.179998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fa76bfeb-0962-4de8-88d2-8f547906a0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:32.274551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 749/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Tue Oct 4 08:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:29:32.565569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e02da-d049-44e4-b50d-722ffd407169 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:29:32.567133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-942e02da-d049-44e4-b50d-722ffd407169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:32.668531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e02da-d049-44e4-b50d-722ffd407169 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:29:32.743322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790f96-1d5f-4a20-91fb-c0e002e2c3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:29:32.744704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790f96-1d5f-4a20-91fb-c0e002e2c3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:29:32.745222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790f96-1d5f-4a20-91fb-c0e002e2c3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:29:32.745584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790f96-1d5f-4a20-91fb-c0e002e2c3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:29:32.747433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b6790f96-1d5f-4a20-91fb-c0e002e2c3f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:29:32.756267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:32.856489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6790f96-1d5f-4a20-91fb-c0e002e2c3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:29:32.857929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6790f96-1d5f-4a20-91fb-c0e002e2c3f5 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:29:32.875990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 744/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:29:42.273062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=82 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:29:42.873836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=50 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:52.396478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb65c-6058-4a49-8933-bfac9fe8a654 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:52.397085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb65c-6058-4a49-8933-bfac9fe8a654 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:52.397085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb65c-6058-4a49-8933-bfac9fe8a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:52.472539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-51aeb65c-6058-4a49-8933-bfac9fe8a654 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:30:52.473757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-51aeb65c-6058-4a49-8933-bfac9fe8a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:52.569012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 750/1494] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:30:52.577007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f692eda-bc9c-42e1-8721-3f5089097e7a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:52.577495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f692eda-bc9c-42e1-8721-3f5089097e7a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:52.577602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f692eda-bc9c-42e1-8721-3f5089097e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:52.653357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5f692eda-bc9c-42e1-8721-3f5089097e7a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:30:52.654502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5f692eda-bc9c-42e1-8721-3f5089097e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:52.748076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 745/1495] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:30:52.752667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aeb65c-6058-4a49-8933-bfac9fe8a654 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:30:52.753855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-51aeb65c-6058-4a49-8933-bfac9fe8a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:52.765485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aeb65c-6058-4a49-8933-bfac9fe8a654 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:30:52.824793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:52.859541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:30:52.860144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:52.860422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:52.860696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:52.861328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:30:52.861630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:30:52.862636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:30:52.862636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: warnings.warn(msg) Oct 04 08:30:52.862636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: Oct 04 08:30:52.863545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:30:52.874458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 751/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:30:52.883688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f692eda-bc9c-42e1-8721-3f5089097e7a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:30:52.892943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f692eda-bc9c-42e1-8721-3f5089097e7a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:30:52.953461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:52.987157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1dfee-1dca-4d2d-99e2-4cb8f44cf1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:30:52.987756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1dfee-1dca-4d2d-99e2-4cb8f44cf1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:52.988032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1dfee-1dca-4d2d-99e2-4cb8f44cf1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:52.988298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1dfee-1dca-4d2d-99e2-4cb8f44cf1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:52.988912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1dfee-1dca-4d2d-99e2-4cb8f44cf1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:30:52.991466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-5cb1dfee-1dca-4d2d-99e2-4cb8f44cf1b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:30:52.991466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: warnings.warn(msg) Oct 04 08:30:52.991466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: Oct 04 08:30:52.992663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1dfee-1dca-4d2d-99e2-4cb8f44cf1b8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:30:53.048665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 746/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:30:52 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:30:53.053429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:30:53.054973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:53.088150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef29e2-1675-43cb-97eb-9b7168295d48 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:30:53.181775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ca89f-cf6d-4b64-9de9-4cffc1456afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:30:53.182518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ca89f-cf6d-4b64-9de9-4cffc1456afb admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:53.182836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ca89f-cf6d-4b64-9de9-4cffc1456afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:53.183107 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ca89f-cf6d-4b64-9de9-4cffc1456afb admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:53.183742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ca89f-cf6d-4b64-9de9-4cffc1456afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:30:53.184754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-aa0ca89f-cf6d-4b64-9de9-4cffc1456afb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:30:53.184754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: warnings.warn(msg) Oct 04 08:30:53.184754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: Oct 04 08:30:53.185964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ca89f-cf6d-4b64-9de9-4cffc1456afb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:30:53.227565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 752/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:30:53 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:30:53.231612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1dfee-1dca-4d2d-99e2-4cb8f44cf1b8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:30:53.233124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5cb1dfee-1dca-4d2d-99e2-4cb8f44cf1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:53.294146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1dfee-1dca-4d2d-99e2-4cb8f44cf1b8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:30:53.379128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:53.390383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0138-e5b1-4162-aa49-ce68a24798b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:30:53.391015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0138-e5b1-4162-aa49-ce68a24798b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:53.391292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0138-e5b1-4162-aa49-ce68a24798b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:53.391559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0138-e5b1-4162-aa49-ce68a24798b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:53.392192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa0138-e5b1-4162-aa49-ce68a24798b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:30:53.393200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-56fa0138-e5b1-4162-aa49-ce68a24798b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:30:53.393200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: warnings.warn(msg) Oct 04 08:30:53.393200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: Oct 04 08:30:53.394094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa0138-e5b1-4162-aa49-ce68a24798b9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:30:53.406240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 747/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:30:53.410485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ca89f-cf6d-4b64-9de9-4cffc1456afb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:30:53.413246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-aa0ca89f-cf6d-4b64-9de9-4cffc1456afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:53.424738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ca89f-cf6d-4b64-9de9-4cffc1456afb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:30:53.450919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:53.520449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22563e78-ce9a-459d-a308-95b2a446ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:30:53.521120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22563e78-ce9a-459d-a308-95b2a446ce1a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:53.521395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22563e78-ce9a-459d-a308-95b2a446ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:53.521662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22563e78-ce9a-459d-a308-95b2a446ce1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:53.522302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22563e78-ce9a-459d-a308-95b2a446ce1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:30:53.523337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-22563e78-ce9a-459d-a308-95b2a446ce1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:30:53.523337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: warnings.warn(msg) Oct 04 08:30:53.523337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: Oct 04 08:30:53.524225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22563e78-ce9a-459d-a308-95b2a446ce1a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:30:53.536091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 753/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:30:53.541049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0138-e5b1-4162-aa49-ce68a24798b9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:30:53.542633 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-56fa0138-e5b1-4162-aa49-ce68a24798b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:53.697852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0138-e5b1-4162-aa49-ce68a24798b9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:30:53.788395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e9c54-eaa9-4806-9116-f766cfaf1d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:30:53.788969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e9c54-eaa9-4806-9116-f766cfaf1d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:53.789243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e9c54-eaa9-4806-9116-f766cfaf1d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:53.789510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e9c54-eaa9-4806-9116-f766cfaf1d6b admin admin] PATH_INFO: `/v3/projects/bc3da487a1004df0b602a8d808df00b8/users/0e7e3d0e3c414884a54c89c5e1e476fd/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:53.811259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e9c54-eaa9-4806-9116-f766cfaf1d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3da487a1004df0b602a8d808df00b8, user_id=0e7e3d0e3c414884a54c89c5e1e476fd, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:30:53.812279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-7a6e9c54-eaa9-4806-9116-f766cfaf1d6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:30:53.812279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: warnings.warn(msg) Oct 04 08:30:53.812279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: Oct 04 08:30:53.814196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e9c54-eaa9-4806-9116-f766cfaf1d6b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:30:53.838260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 748/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:30:53 2022] PUT /identity/v3/projects/bc3da487a1004df0b602a8d808df00b8/users/0e7e3d0e3c414884a54c89c5e1e476fd/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:30:53.850928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ba3be-4936-46e3-b5c9-54087e22ad0c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:53.851215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ba3be-4936-46e3-b5c9-54087e22ad0c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:53.851490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ba3be-4936-46e3-b5c9-54087e22ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:53.907058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ae6ba3be-4936-46e3-b5c9-54087e22ad0c None None] MFA Rules not processed for user `0e7e3d0e3c414884a54c89c5e1e476fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:30:53.908263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ae6ba3be-4936-46e3-b5c9-54087e22ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:53.986061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 754/1502] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:30:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:30:53.999412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c87a-3819-4436-a831-c6b80f41b88c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:53.999696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c87a-3819-4436-a831-c6b80f41b88c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:53.999967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c87a-3819-4436-a831-c6b80f41b88c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:54.001284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 749/1503] 10.222.0.23 () {54 vars in 963 bytes} [Tue Oct 4 08:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:30:54.006296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88ea3a-82bc-4aae-9728-01d25a489bb6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:54.006579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88ea3a-82bc-4aae-9728-01d25a489bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:54.006890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88ea3a-82bc-4aae-9728-01d25a489bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:54.038311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:54.081626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bb88ea3a-82bc-4aae-9728-01d25a489bb6 None None] MFA Rules not processed for user `53db39d8c5d1459294b0376d052a9495`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:30:54.082805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bb88ea3a-82bc-4aae-9728-01d25a489bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:54.157248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 755/1504] 10.222.0.23 () {58 vars in 1060 bytes} [Tue Oct 4 08:30:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:30:54.165485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c87a-3819-4436-a831-c6b80f41b88c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:30:54.167023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3189c87a-3819-4436-a831-c6b80f41b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:54.216312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:54.269333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c87a-3819-4436-a831-c6b80f41b88c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:30:54.341811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1691d-21f8-46a8-9a4a-3c7b9fc80174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:30:54.342336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1691d-21f8-46a8-9a4a-3c7b9fc80174 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:54.342608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1691d-21f8-46a8-9a4a-3c7b9fc80174 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:54.342903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1691d-21f8-46a8-9a4a-3c7b9fc80174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:54.344473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-76b1691d-21f8-46a8-9a4a-3c7b9fc80174 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:54.444934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1691d-21f8-46a8-9a4a-3c7b9fc80174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:30:54.446367 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1691d-21f8-46a8-9a4a-3c7b9fc80174 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:30:54.449777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:54.465169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 750/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:30:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:30:54.514266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b162d45-166b-4d6d-b6f4-b2fb44524759 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:54.514850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b162d45-166b-4d6d-b6f4-b2fb44524759 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:54.514850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b162d45-166b-4d6d-b6f4-b2fb44524759 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:54.516280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 756/1506] 10.222.0.23 () {52 vars in 830 bytes} [Tue Oct 4 08:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:30:54.520610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1691d-21f8-46a8-9a4a-3c7b9fc80174 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:30:54.521946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-76b1691d-21f8-46a8-9a4a-3c7b9fc80174 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:54.627716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1691d-21f8-46a8-9a4a-3c7b9fc80174 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:30:54.720551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:30:54.721271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:54.721433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:54.721702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] PATH_INFO: `/v3/users/0e7e3d0e3c414884a54c89c5e1e476fd` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:54.734175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7e3d0e3c414884a54c89c5e1e476fd)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:30:54.735302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:30:54.735302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: warnings.warn(msg) Oct 04 08:30:54.735302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: Oct 04 08:30:54.736509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:30:54.746751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:54.803328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7e3d0e3c414884a54c89c5e1e476fd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:30:54.803872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7e3d0e3c414884a54c89c5e1e476fd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:30:54.817424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7e3d0e3c414884a54c89c5e1e476fd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:30:54.818959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7e3d0e3c414884a54c89c5e1e476fd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:30:54.841447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7e3d0e3c414884a54c89c5e1e476fd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:30:54.857267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 751/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:30:54 2022] DELETE /identity/v3/users/0e7e3d0e3c414884a54c89c5e1e476fd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:30:54.861794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ddc8-e044-4d89-b698-cddbd093d474 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:54.862086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ddc8-e044-4d89-b698-cddbd093d474 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:54.862368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ddc8-e044-4d89-b698-cddbd093d474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:54.920406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7d06ddc8-e044-4d89-b698-cddbd093d474 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:30:54.921546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7d06ddc8-e044-4d89-b698-cddbd093d474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:55.001144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:55.013844 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 757/1508] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:30:55.023576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:30:55.024791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:55.125259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3995743-0a82-4909-ab73-1b82de5043c9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:30:55.181987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:30:55.202570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b4e4c-cbce-4ee8-991a-9ff9ca6e140e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:30:55.203210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4e4c-cbce-4ee8-991a-9ff9ca6e140e service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:55.203489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4e4c-cbce-4ee8-991a-9ff9ca6e140e service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:55.203761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4e4c-cbce-4ee8-991a-9ff9ca6e140e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:55.205359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-778b4e4c-cbce-4ee8-991a-9ff9ca6e140e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:55.311840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b4e4c-cbce-4ee8-991a-9ff9ca6e140e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:30:55.313282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b4e4c-cbce-4ee8-991a-9ff9ca6e140e service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:30:55.331568 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 752/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:30:55.674579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06ddc8-e044-4d89-b698-cddbd093d474 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:30:55.675856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7d06ddc8-e044-4d89-b698-cddbd093d474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:30:55.687144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06ddc8-e044-4d89-b698-cddbd093d474 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:30:55.784173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:30:55.784796 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:30:55.785071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:30:55.785339 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] PATH_INFO: `/v3/projects/bc3da487a1004df0b602a8d808df00b8` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:30:55.795261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3da487a1004df0b602a8d808df00b8)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:30:55.796274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:30:55.796274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: warnings.warn(msg) Oct 04 08:30:55.796274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: Oct 04 08:30:55.797465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:30:55.855139 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3da487a1004df0b602a8d808df00b8', 'request_id': 'req-ab50bc45-9953-46f8-897c-27d728b65aeb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:30:55.867989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3da487a1004df0b602a8d808df00b8', 'request_id': 'req-ab50bc45-9953-46f8-897c-27d728b65aeb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:30:55.873806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3da487a1004df0b602a8d808df00b8', 'request_id': 'req-ab50bc45-9953-46f8-897c-27d728b65aeb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:30:55.901169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] The token cache is being invalidate because project bc3da487a1004df0b602a8d808df00b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:30:55.901455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:30:55.901879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ab50bc45-9953-46f8-897c-27d728b65aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:30:55.903372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 758/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:30:55 2022] DELETE /identity/v3/projects/bc3da487a1004df0b602a8d808df00b8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:31:05.329148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=62 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:31:05.899051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.053753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897efc2c-73c8-4c93-a959-3980a3ebd77d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.054370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897efc2c-73c8-4c93-a959-3980a3ebd77d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.054370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897efc2c-73c8-4c93-a959-3980a3ebd77d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.055680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:36.060592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330097b8-69ba-4e29-9517-9f56808c1e1a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.061008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330097b8-69ba-4e29-9517-9f56808c1e1a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.061152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330097b8-69ba-4e29-9517-9f56808c1e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.145568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-330097b8-69ba-4e29-9517-9f56808c1e1a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:36.146833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-330097b8-69ba-4e29-9517-9f56808c1e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:36.252341 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:32:36.406823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897efc2c-73c8-4c93-a959-3980a3ebd77d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.409642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-897efc2c-73c8-4c93-a959-3980a3ebd77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:36.529189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897efc2c-73c8-4c93-a959-3980a3ebd77d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.534899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2a2cf-43d2-4e0e-a692-11db97d8339f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.535504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2a2cf-43d2-4e0e-a692-11db97d8339f service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.535779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2a2cf-43d2-4e0e-a692-11db97d8339f service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.536046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2a2cf-43d2-4e0e-a692-11db97d8339f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.544336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2a2cf-43d2-4e0e-a692-11db97d8339f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.545911 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2a2cf-43d2-4e0e-a692-11db97d8339f service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.555129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 754/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:32:37.272613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4ce3b-0be1-4b34-b67a-b73598d40d05 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.273181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4ce3b-0be1-4b34-b67a-b73598d40d05 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.273181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4ce3b-0be1-4b34-b67a-b73598d40d05 None None] PATH_INFO: `/v3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.274466 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 760/1514] 10.222.0.18 () {54 vars in 925 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:37.303646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de82c1-55f6-4b06-a09c-16c6cec5ec27 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.304183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de82c1-55f6-4b06-a09c-16c6cec5ec27 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.304292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de82c1-55f6-4b06-a09c-16c6cec5ec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.364682 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-27de82c1-55f6-4b06-a09c-16c6cec5ec27 None None] MFA Rules not processed for user `6a4030325cf0481ab634e253cfed9c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:37.365918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-27de82c1-55f6-4b06-a09c-16c6cec5ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:37.432486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.438506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 755/1515] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Oct 4 08:32:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:32:37.636734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09233c6-5300-4f40-8e59-da3849144523 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.636956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09233c6-5300-4f40-8e59-da3849144523 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.637218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09233c6-5300-4f40-8e59-da3849144523 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.638602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 761/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:37.645370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4b575-8196-42a3-9d55-625e196da42f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.645657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4b575-8196-42a3-9d55-625e196da42f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.645936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4b575-8196-42a3-9d55-625e196da42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.665742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eca4b575-8196-42a3-9d55-625e196da42f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:37.666958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eca4b575-8196-42a3-9d55-625e196da42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:37.674597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 756/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:32:37.825517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09233c6-5300-4f40-8e59-da3849144523 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.840198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09233c6-5300-4f40-8e59-da3849144523 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.845536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970d774-73a4-48a3-a6d3-3e3b9c90944a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.846127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d774-73a4-48a3-a6d3-3e3b9c90944a service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.847075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d774-73a4-48a3-a6d3-3e3b9c90944a service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.847369 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d774-73a4-48a3-a6d3-3e3b9c90944a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.855194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970d774-73a4-48a3-a6d3-3e3b9c90944a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.856763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970d774-73a4-48a3-a6d3-3e3b9c90944a service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.865993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 762/1518] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:32:41.073465 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85af2e-76be-479a-9b31-1a521b4021f5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.074016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85af2e-76be-479a-9b31-1a521b4021f5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.074114 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85af2e-76be-479a-9b31-1a521b4021f5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.075438 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 757/1519] 10.222.0.23 () {54 vars in 961 bytes} [Tue Oct 4 08:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:41.080377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c159a7-1c39-4a89-b2de-79715aa96df2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.081335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c159a7-1c39-4a89-b2de-79715aa96df2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.081335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c159a7-1c39-4a89-b2de-79715aa96df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.102010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-25c159a7-1c39-4a89-b2de-79715aa96df2 None None] MFA Rules not processed for user `6a4030325cf0481ab634e253cfed9c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:41.103259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-25c159a7-1c39-4a89-b2de-79715aa96df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:41.113015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 763/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Oct 4 08:32:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:32:41.120596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85af2e-76be-479a-9b31-1a521b4021f5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.133772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85af2e-76be-479a-9b31-1a521b4021f5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.138583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c254e-6af0-47bd-a1b7-a3e32222ef1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4030325cf0481ab634e253cfed9c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.139203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c254e-6af0-47bd-a1b7-a3e32222ef1d service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.139475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c254e-6af0-47bd-a1b7-a3e32222ef1d service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.139746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c254e-6af0-47bd-a1b7-a3e32222ef1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.147880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c254e-6af0-47bd-a1b7-a3e32222ef1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:41.149454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c254e-6af0-47bd-a1b7-a3e32222ef1d service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:41.159372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 758/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:32:49.351942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f57ffb-4b0d-4c69-a55a-aedbbb3148ca None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.352485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f57ffb-4b0d-4c69-a55a-aedbbb3148ca None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.352485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f57ffb-4b0d-4c69-a55a-aedbbb3148ca None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.353869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:49.360008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49e30e-4d83-45ca-861d-f6f76794e45a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.360463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49e30e-4d83-45ca-861d-f6f76794e45a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.360559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49e30e-4d83-45ca-861d-f6f76794e45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.383063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5b49e30e-4d83-45ca-861d-f6f76794e45a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:49.384276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5b49e30e-4d83-45ca-861d-f6f76794e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:49.391890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:32:49.552869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f57ffb-4b0d-4c69-a55a-aedbbb3148ca None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.567194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f57ffb-4b0d-4c69-a55a-aedbbb3148ca None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.572565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773424d5-ae3f-44b8-97b1-c1f1744b7dcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.573159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773424d5-ae3f-44b8-97b1-c1f1744b7dcf service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.573437 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773424d5-ae3f-44b8-97b1-c1f1744b7dcf service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.573709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773424d5-ae3f-44b8-97b1-c1f1744b7dcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.582480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773424d5-ae3f-44b8-97b1-c1f1744b7dcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:49.584088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773424d5-ae3f-44b8-97b1-c1f1744b7dcf service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:49.593220 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 765/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:32:50.669243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870128bd-aabb-4fee-a8cc-4e08942bef02 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.669788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870128bd-aabb-4fee-a8cc-4e08942bef02 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.670070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870128bd-aabb-4fee-a8cc-4e08942bef02 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.671457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:50.678225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941522d1-04f3-4d27-a67d-1c7e1f6ca5d2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.678693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941522d1-04f3-4d27-a67d-1c7e1f6ca5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.678824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941522d1-04f3-4d27-a67d-1c7e1f6ca5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.698485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-941522d1-04f3-4d27-a67d-1c7e1f6ca5d2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:50.699716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-941522d1-04f3-4d27-a67d-1c7e1f6ca5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:50.707596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:32:50.859245 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870128bd-aabb-4fee-a8cc-4e08942bef02 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:50.873750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870128bd-aabb-4fee-a8cc-4e08942bef02 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.879346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0da5a5-affa-44f3-94a1-b70e0890fd9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.879936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0da5a5-affa-44f3-94a1-b70e0890fd9c service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.880214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0da5a5-affa-44f3-94a1-b70e0890fd9c service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.880486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0da5a5-affa-44f3-94a1-b70e0890fd9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.888332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0da5a5-affa-44f3-94a1-b70e0890fd9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:50.889891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0da5a5-affa-44f3-94a1-b70e0890fd9c service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:50.899093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 761/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:32:55.288656 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d47f-df96-4b2c-bf13-b435c93b6163 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.289318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d47f-df96-4b2c-bf13-b435c93b6163 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.289318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d47f-df96-4b2c-bf13-b435c93b6163 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.290529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:55.295979 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ad11-4597-4829-8c1c-5506110d7348 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.296385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ad11-4597-4829-8c1c-5506110d7348 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.296505 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ad11-4597-4829-8c1c-5506110d7348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.317418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2f61ad11-4597-4829-8c1c-5506110d7348 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:55.318619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2f61ad11-4597-4829-8c1c-5506110d7348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:55.326602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:32:55.613248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d47f-df96-4b2c-bf13-b435c93b6163 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.614986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8476d47f-df96-4b2c-bf13-b435c93b6163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:55.647670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.692517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d47f-df96-4b2c-bf13-b435c93b6163 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.696036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcb7a0-e696-44f1-b027-d333a5c3a72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.696632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcb7a0-e696-44f1-b027-d333a5c3a72f service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.696906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcb7a0-e696-44f1-b027-d333a5c3a72f service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.697173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcb7a0-e696-44f1-b027-d333a5c3a72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.706304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcb7a0-e696-44f1-b027-d333a5c3a72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.707758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcb7a0-e696-44f1-b027-d333a5c3a72f service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.716846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 768/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:32:57.871953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c55c5-de5f-4253-85a4-cb57ae2a5610 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.872521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c55c5-de5f-4253-85a4-cb57ae2a5610 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.872521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c55c5-de5f-4253-85a4-cb57ae2a5610 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.873766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:57.879216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7e68d-cfc1-4a89-9ab3-8849bc39707b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.879610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7e68d-cfc1-4a89-9ab3-8849bc39707b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.879760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7e68d-cfc1-4a89-9ab3-8849bc39707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.900808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-19f7e68d-cfc1-4a89-9ab3-8849bc39707b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:57.902004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-19f7e68d-cfc1-4a89-9ab3-8849bc39707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:57.910264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:32:58.201555 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c55c5-de5f-4253-85a4-cb57ae2a5610 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.203256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-961c55c5-de5f-4253-85a4-cb57ae2a5610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:58.216458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c55c5-de5f-4253-85a4-cb57ae2a5610 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.219893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47df84-8ce9-4998-9560-64deb937b3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.220475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47df84-8ce9-4998-9560-64deb937b3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.220777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47df84-8ce9-4998-9560-64deb937b3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.221048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47df84-8ce9-4998-9560-64deb937b3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.229595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47df84-8ce9-4998-9560-64deb937b3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:58.231047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47df84-8ce9-4998-9560-64deb937b3d8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:58.240271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 764/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:33:02.122912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029846d-3110-4020-a05a-f77edea38ad6 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.123467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029846d-3110-4020-a05a-f77edea38ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.123467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029846d-3110-4020-a05a-f77edea38ad6 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.124821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:02.130463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b55f8d-3e37-440e-abe8-72cb94d41838 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.130988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b55f8d-3e37-440e-abe8-72cb94d41838 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.131088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b55f8d-3e37-440e-abe8-72cb94d41838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.150547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d5b55f8d-3e37-440e-abe8-72cb94d41838 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:02.151778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d5b55f8d-3e37-440e-abe8-72cb94d41838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:02.159410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:33:02.461058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029846d-3110-4020-a05a-f77edea38ad6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.462763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7029846d-3110-4020-a05a-f77edea38ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:02.539254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029846d-3110-4020-a05a-f77edea38ad6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.542784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7b710-b530-4168-87ab-7c36707e8c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.543384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b710-b530-4168-87ab-7c36707e8c81 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.543659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b710-b530-4168-87ab-7c36707e8c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.543925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b710-b530-4168-87ab-7c36707e8c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.553112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7b710-b530-4168-87ab-7c36707e8c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.554545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7b710-b530-4168-87ab-7c36707e8c81 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.563664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 771/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:33:04.719708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147449-cc8f-41e0-aa7b-b54c4edbba95 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:04.720407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147449-cc8f-41e0-aa7b-b54c4edbba95 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:04.720407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147449-cc8f-41e0-aa7b-b54c4edbba95 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:04.722263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:04.727463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43f79c-c443-4cee-b59a-e21ecdd3ba9a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:04.727899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43f79c-c443-4cee-b59a-e21ecdd3ba9a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:04.728008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43f79c-c443-4cee-b59a-e21ecdd3ba9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:04.747564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fd43f79c-c443-4cee-b59a-e21ecdd3ba9a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:04.748758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fd43f79c-c443-4cee-b59a-e21ecdd3ba9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:04.756525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:33:05.059474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147449-cc8f-41e0-aa7b-b54c4edbba95 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:05.061168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ba147449-cc8f-41e0-aa7b-b54c4edbba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:05.074411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147449-cc8f-41e0-aa7b-b54c4edbba95 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:05.077924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13176e7-4272-4648-bfe6-d33a5fdb5cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:05.078513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13176e7-4272-4648-bfe6-d33a5fdb5cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.078832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13176e7-4272-4648-bfe6-d33a5fdb5cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.079103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13176e7-4272-4648-bfe6-d33a5fdb5cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.088428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13176e7-4272-4648-bfe6-d33a5fdb5cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:05.089843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13176e7-4272-4648-bfe6-d33a5fdb5cb8 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:05.099187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 767/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:33:14.742741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=63 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:15.095605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=37 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:36.228337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387db74-eaaf-4d4d-be0a-62d5cc4bd1f4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.232278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387db74-eaaf-4d4d-be0a-62d5cc4bd1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.232278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387db74-eaaf-4d4d-be0a-62d5cc4bd1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.259719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9387db74-eaaf-4d4d-be0a-62d5cc4bd1f4 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.261477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9387db74-eaaf-4d4d-be0a-62d5cc4bd1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.275827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 773/1540] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:34:36.286162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7caaf9-c3f9-4f75-bee6-b157dd4ddd1d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.287700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7caaf9-c3f9-4f75-bee6-b157dd4ddd1d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.287700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7caaf9-c3f9-4f75-bee6-b157dd4ddd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.317560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7c7caaf9-c3f9-4f75-bee6-b157dd4ddd1d None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.319031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7c7caaf9-c3f9-4f75-bee6-b157dd4ddd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.334017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 768/1541] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.338825 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387db74-eaaf-4d4d-be0a-62d5cc4bd1f4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.352785 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387db74-eaaf-4d4d-be0a-62d5cc4bd1f4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.361638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db0e2-ace4-4084-a3b4-8ee3030d2b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.362972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db0e2-ace4-4084-a3b4-8ee3030d2b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.363806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db0e2-ace4-4084-a3b4-8ee3030d2b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.364372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db0e2-ace4-4084-a3b4-8ee3030d2b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.365308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20db0e2-ace4-4084-a3b4-8ee3030d2b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:36.365852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20db0e2-ace4-4084-a3b4-8ee3030d2b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.371175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20db0e2-ace4-4084-a3b4-8ee3030d2b75 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.386833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 774/1542] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:36.396259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7caaf9-c3f9-4f75-bee6-b157dd4ddd1d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.412126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7caaf9-c3f9-4f75-bee6-b157dd4ddd1d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.418752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a9cf-ca1a-4e6a-bed9-4227ccb9d3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.419465 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a9cf-ca1a-4e6a-bed9-4227ccb9d3ba admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.419857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a9cf-ca1a-4e6a-bed9-4227ccb9d3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.420216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a9cf-ca1a-4e6a-bed9-4227ccb9d3ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.420992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a9cf-ca1a-4e6a-bed9-4227ccb9d3ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.423001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a9cf-ca1a-4e6a-bed9-4227ccb9d3ba admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.495600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 769/1543] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:36.500514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db0e2-ace4-4084-a3b4-8ee3030d2b75 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.518075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db0e2-ace4-4084-a3b4-8ee3030d2b75 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.618425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04479fa-8c13-446c-8f8b-6fb94829f8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.619510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04479fa-8c13-446c-8f8b-6fb94829f8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.620027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04479fa-8c13-446c-8f8b-6fb94829f8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.620536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04479fa-8c13-446c-8f8b-6fb94829f8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.622172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04479fa-8c13-446c-8f8b-6fb94829f8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.624988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04479fa-8c13-446c-8f8b-6fb94829f8a2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.633045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136f09-2f36-4067-96c2-5bf4b22c759f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.633339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136f09-2f36-4067-96c2-5bf4b22c759f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.633620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136f09-2f36-4067-96c2-5bf4b22c759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.667812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-16136f09-2f36-4067-96c2-5bf4b22c759f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.669142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-16136f09-2f36-4067-96c2-5bf4b22c759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.676275 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 775/1544] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:36.678017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba19b-4bb6-48b9-9b63-8a64312e4c32 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.678481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba19b-4bb6-48b9-9b63-8a64312e4c32 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.678953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba19b-4bb6-48b9-9b63-8a64312e4c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.696106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 770/1545] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.697242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16136f09-2f36-4067-96c2-5bf4b22c759f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.708942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-725ba19b-4bb6-48b9-9b63-8a64312e4c32 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.710150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-725ba19b-4bb6-48b9-9b63-8a64312e4c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.719672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16136f09-2f36-4067-96c2-5bf4b22c759f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.726304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 776/1546] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.728042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0211f-ab6f-4d51-855c-496df35fb40f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.728333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0211f-ab6f-4d51-855c-496df35fb40f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.728642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0211f-ab6f-4d51-855c-496df35fb40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.740118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c2962-16f6-4f2e-bf7f-4f3cbe4fe44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.741248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2962-16f6-4f2e-bf7f-4f3cbe4fe44f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.741835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2962-16f6-4f2e-bf7f-4f3cbe4fe44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.742269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2962-16f6-4f2e-bf7f-4f3cbe4fe44f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.743114 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c2962-16f6-4f2e-bf7f-4f3cbe4fe44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.745988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c2962-16f6-4f2e-bf7f-4f3cbe4fe44f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.762926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d2d0211f-ab6f-4d51-855c-496df35fb40f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.764319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d2d0211f-ab6f-4d51-855c-496df35fb40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.768781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 771/1547] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:36.770270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b32166-d499-436d-a0b0-df85bdd476d7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.770772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b32166-d499-436d-a0b0-df85bdd476d7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.771236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b32166-d499-436d-a0b0-df85bdd476d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.789457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 777/1548] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.795025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143d0c-b27f-4fa0-bef5-c74be6d9cdb4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.795025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143d0c-b27f-4fa0-bef5-c74be6d9cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.795025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143d0c-b27f-4fa0-bef5-c74be6d9cdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.807746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-31b32166-d499-436d-a0b0-df85bdd476d7 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.810916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-31b32166-d499-436d-a0b0-df85bdd476d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.815871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-99143d0c-b27f-4fa0-bef5-c74be6d9cdb4 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.817141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-99143d0c-b27f-4fa0-bef5-c74be6d9cdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.820358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 772/1549] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.821764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a2a1-b024-459f-92c3-70ab42322ff8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.822225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a2a1-b024-459f-92c3-70ab42322ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.822666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a2a1-b024-459f-92c3-70ab42322ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.831335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 778/1550] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.832700 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59fbbc-2ba4-4bbd-9e94-6a85ec95757b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.833058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59fbbc-2ba4-4bbd-9e94-6a85ec95757b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.833328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59fbbc-2ba4-4bbd-9e94-6a85ec95757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.851093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-df29a2a1-b024-459f-92c3-70ab42322ff8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.853158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-df29a2a1-b024-459f-92c3-70ab42322ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.866858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3e59fbbc-2ba4-4bbd-9e94-6a85ec95757b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.866858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3e59fbbc-2ba4-4bbd-9e94-6a85ec95757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.870573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 773/1551] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.871436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a2a1-b024-459f-92c3-70ab42322ff8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.874263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 779/1552] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.879686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59fbbc-2ba4-4bbd-9e94-6a85ec95757b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.881718 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a2a1-b024-459f-92c3-70ab42322ff8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.886508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08463ec-3ded-4792-93c0-c80859a127ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.887692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08463ec-3ded-4792-93c0-c80859a127ef admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.888204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08463ec-3ded-4792-93c0-c80859a127ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.888670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08463ec-3ded-4792-93c0-c80859a127ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.889812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08463ec-3ded-4792-93c0-c80859a127ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.891908 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59fbbc-2ba4-4bbd-9e94-6a85ec95757b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.892755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08463ec-3ded-4792-93c0-c80859a127ef admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.897750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f8653-d25e-458c-9194-4b72d77c7b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.898900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f8653-d25e-458c-9194-4b72d77c7b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.899400 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f8653-d25e-458c-9194-4b72d77c7b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.900045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f8653-d25e-458c-9194-4b72d77c7b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.901271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f8653-d25e-458c-9194-4b72d77c7b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:36.901844 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f8653-d25e-458c-9194-4b72d77c7b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.904243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 774/1553] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:36.904744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f8653-d25e-458c-9194-4b72d77c7b6c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.905083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08463ec-3ded-4792-93c0-c80859a127ef admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.915291 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08463ec-3ded-4792-93c0-c80859a127ef admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.920299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85289c-2040-477c-ae68-68331d207f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.920465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 780/1554] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:36.920895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85289c-2040-477c-ae68-68331d207f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.921170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85289c-2040-477c-ae68-68331d207f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.921440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85289c-2040-477c-ae68-68331d207f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.921618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcebc7-f1eb-4371-90d7-bd43186f39f3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.922012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcebc7-f1eb-4371-90d7-bd43186f39f3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.922128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85289c-2040-477c-ae68-68331d207f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:36.922289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcebc7-f1eb-4371-90d7-bd43186f39f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.922402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85289c-2040-477c-ae68-68331d207f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.923389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-5e85289c-2040-477c-ae68-68331d207f5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:34:36.923389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: warnings.warn(msg) Oct 04 08:34:36.923389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: Oct 04 08:34:36.924266 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85289c-2040-477c-ae68-68331d207f5c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.937183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 775/1555] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:36.938257 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34365f7b-fc04-4883-b0c3-e93897511264 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.938543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34365f7b-fc04-4883-b0c3-e93897511264 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.938848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34365f7b-fc04-4883-b0c3-e93897511264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.942049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-58dcebc7-f1eb-4371-90d7-bd43186f39f3 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.943350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-58dcebc7-f1eb-4371-90d7-bd43186f39f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.956506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 781/1556] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.956506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a13add-4c27-4a8b-8120-1282afbbb217 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.956506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a13add-4c27-4a8b-8120-1282afbbb217 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.956506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a13add-4c27-4a8b-8120-1282afbbb217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.961220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-34365f7b-fc04-4883-b0c3-e93897511264 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.962410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-34365f7b-fc04-4883-b0c3-e93897511264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.974804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 776/1557] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.974804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccb34c-7dc0-4772-887e-1f2b440aa34d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.974804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccb34c-7dc0-4772-887e-1f2b440aa34d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.974804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccb34c-7dc0-4772-887e-1f2b440aa34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.976104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-14a13add-4c27-4a8b-8120-1282afbbb217 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.977317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-14a13add-4c27-4a8b-8120-1282afbbb217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.985949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 782/1558] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:36.987194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641c0f2-f85b-4cd2-a527-026c7b798e6e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.987476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641c0f2-f85b-4cd2-a527-026c7b798e6e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.987749 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641c0f2-f85b-4cd2-a527-026c7b798e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.992741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-58ccb34c-7dc0-4772-887e-1f2b440aa34d None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.993981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-58ccb34c-7dc0-4772-887e-1f2b440aa34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:37.002391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 777/1559] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:37.003191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccb34c-7dc0-4772-887e-1f2b440aa34d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.009600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0641c0f2-f85b-4cd2-a527-026c7b798e6e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:37.010812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0641c0f2-f85b-4cd2-a527-026c7b798e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:37.013026 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccb34c-7dc0-4772-887e-1f2b440aa34d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.017491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e415a21-c461-4f0f-9941-1aa0e7aa9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.018126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e415a21-c461-4f0f-9941-1aa0e7aa9429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.018407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e415a21-c461-4f0f-9941-1aa0e7aa9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.018706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e415a21-c461-4f0f-9941-1aa0e7aa9429 admin admin] PATH_INFO: `/v3/projects/056882bbdaa0494ba11586fd24fb41fa/users/0f98295f825e4d0c8fc54cf9cc07bae4/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.019183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 783/1560] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:37.019921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641c0f2-f85b-4cd2-a527-026c7b798e6e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.029592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641c0f2-f85b-4cd2-a527-026c7b798e6e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.034168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990fe0c-41bb-4f37-abfc-f473938f91df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.034336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e415a21-c461-4f0f-9941-1aa0e7aa9429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056882bbdaa0494ba11586fd24fb41fa, user_id=0f98295f825e4d0c8fc54cf9cc07bae4, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.035038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990fe0c-41bb-4f37-abfc-f473938f91df admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.035317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990fe0c-41bb-4f37-abfc-f473938f91df admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.035585 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990fe0c-41bb-4f37-abfc-f473938f91df admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.036200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990fe0c-41bb-4f37-abfc-f473938f91df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.037198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-0990fe0c-41bb-4f37-abfc-f473938f91df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:34:37.037198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: warnings.warn(msg) Oct 04 08:34:37.037198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: Oct 04 08:34:37.037473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e415a21-c461-4f0f-9941-1aa0e7aa9429 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.038374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990fe0c-41bb-4f37-abfc-f473938f91df admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.051449 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 778/1561] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:37 2022] PUT /identity/v3/projects/056882bbdaa0494ba11586fd24fb41fa/users/0f98295f825e4d0c8fc54cf9cc07bae4/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:37.052324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e415a21-c461-4f0f-9941-1aa0e7aa9429 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.069058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 784/1562] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.070097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990fe0c-41bb-4f37-abfc-f473938f91df admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.118069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:37.124724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e415a21-c461-4f0f-9941-1aa0e7aa9429 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.129673 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff559f-1d38-48cd-b3e0-96125c02c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.130355 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff559f-1d38-48cd-b3e0-96125c02c2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.130726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff559f-1d38-48cd-b3e0-96125c02c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.131074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff559f-1d38-48cd-b3e0-96125c02c2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.131773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff559f-1d38-48cd-b3e0-96125c02c2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.133555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990fe0c-41bb-4f37-abfc-f473938f91df admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.133749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff559f-1d38-48cd-b3e0-96125c02c2b6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.138422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1134ba-bb78-44e0-aefc-4bb67bb01f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.139074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1134ba-bb78-44e0-aefc-4bb67bb01f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.139350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1134ba-bb78-44e0-aefc-4bb67bb01f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.139624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1134ba-bb78-44e0-aefc-4bb67bb01f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.140262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1134ba-bb78-44e0-aefc-4bb67bb01f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:37.140570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1134ba-bb78-44e0-aefc-4bb67bb01f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.142133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1134ba-bb78-44e0-aefc-4bb67bb01f91 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.154335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 785/1563] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:37.155674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb95d1-a637-406d-b5af-5ba5de5be7c3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.155958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb95d1-a637-406d-b5af-5ba5de5be7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.156229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb95d1-a637-406d-b5af-5ba5de5be7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.164589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 779/1564] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.166067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7197-0258-4a9f-8081-f8288c573e33 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.166354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7197-0258-4a9f-8081-f8288c573e33 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.166627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7197-0258-4a9f-8081-f8288c573e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.180860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0ccb95d1-a637-406d-b5af-5ba5de5be7c3 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:37.182061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0ccb95d1-a637-406d-b5af-5ba5de5be7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:37.187210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-157e7197-0258-4a9f-8081-f8288c573e33 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:37.188389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-157e7197-0258-4a9f-8081-f8288c573e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:37.199528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:37.247943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 786/1565] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:37.248799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb95d1-a637-406d-b5af-5ba5de5be7c3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.257850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb95d1-a637-406d-b5af-5ba5de5be7c3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.258760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 780/1566] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:37.259595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e7197-0258-4a9f-8081-f8288c573e33 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.262535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaabc99-a178-4c43-ad3a-d5273769fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.263162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaabc99-a178-4c43-ad3a-d5273769fedb admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.263442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaabc99-a178-4c43-ad3a-d5273769fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.263718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaabc99-a178-4c43-ad3a-d5273769fedb admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.264358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaabc99-a178-4c43-ad3a-d5273769fedb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:37.264663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaabc99-a178-4c43-ad3a-d5273769fedb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.266257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaabc99-a178-4c43-ad3a-d5273769fedb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.268984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e7197-0258-4a9f-8081-f8288c573e33 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.273536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6afb8-c164-4e91-8a8d-fb897e1d0e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.274120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6afb8-c164-4e91-8a8d-fb897e1d0e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.274397 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6afb8-c164-4e91-8a8d-fb897e1d0e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.274692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6afb8-c164-4e91-8a8d-fb897e1d0e57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.275334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6afb8-c164-4e91-8a8d-fb897e1d0e57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:37.275635 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6afb8-c164-4e91-8a8d-fb897e1d0e57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.277205 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6afb8-c164-4e91-8a8d-fb897e1d0e57 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.278173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 787/1567] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:37.279452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcb12-9e88-4489-be09-662302b01290 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.279740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcb12-9e88-4489-be09-662302b01290 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.280426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcb12-9e88-4489-be09-662302b01290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.298008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 781/1568] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:37.298008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6afb8-c164-4e91-8a8d-fb897e1d0e57 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.299723 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c8dfcb12-9e88-4489-be09-662302b01290 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:37.301073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c8dfcb12-9e88-4489-be09-662302b01290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:37.301572 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6afb8-c164-4e91-8a8d-fb897e1d0e57 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.306087 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af364b-fa4a-4c75-8399-d654b52c4941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.306697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af364b-fa4a-4c75-8399-d654b52c4941 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.306976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af364b-fa4a-4c75-8399-d654b52c4941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.307241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af364b-fa4a-4c75-8399-d654b52c4941 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.307855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af364b-fa4a-4c75-8399-d654b52c4941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.309401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-12af364b-fa4a-4c75-8399-d654b52c4941 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:34:37.309401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: warnings.warn(msg) Oct 04 08:34:37.309401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: Oct 04 08:34:37.310193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 788/1569] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:37.310632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af364b-fa4a-4c75-8399-d654b52c4941 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.310983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfcb12-9e88-4489-be09-662302b01290 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.320495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfcb12-9e88-4489-be09-662302b01290 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.327131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cb187-9bca-4123-8073-e83f0d9bab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.327772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb187-9bca-4123-8073-e83f0d9bab3f admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.328053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb187-9bca-4123-8073-e83f0d9bab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.328331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb187-9bca-4123-8073-e83f0d9bab3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.328998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cb187-9bca-4123-8073-e83f0d9bab3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.331075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cb187-9bca-4123-8073-e83f0d9bab3f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.333517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 782/1570] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.334310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af364b-fa4a-4c75-8399-d654b52c4941 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.344005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af364b-fa4a-4c75-8399-d654b52c4941 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.349455 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4b03f-944e-4462-85ea-eb333a2586c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.350257 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4b03f-944e-4462-85ea-eb333a2586c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.350539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4b03f-944e-4462-85ea-eb333a2586c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.350840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4b03f-944e-4462-85ea-eb333a2586c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.351590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4b03f-944e-4462-85ea-eb333a2586c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.353732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4b03f-944e-4462-85ea-eb333a2586c5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.364707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 789/1571] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.365750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cb187-9bca-4123-8073-e83f0d9bab3f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.378740 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 783/1572] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/users => generated 284 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.379631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4b03f-944e-4462-85ea-eb333a2586c5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.389265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4b03f-944e-4462-85ea-eb333a2586c5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.432848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cb187-9bca-4123-8073-e83f0d9bab3f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.438284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f80d-d497-404c-9cca-e734fdefc6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.438919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f80d-d497-404c-9cca-e734fdefc6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.439185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f80d-d497-404c-9cca-e734fdefc6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.439454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f80d-d497-404c-9cca-e734fdefc6dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.440088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11f80d-d497-404c-9cca-e734fdefc6dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:37.440388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11f80d-d497-404c-9cca-e734fdefc6dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.441967 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11f80d-d497-404c-9cca-e734fdefc6dc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.444493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2354e-7e03-4e49-b890-a644c14db4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.445097 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2354e-7e03-4e49-b890-a644c14db4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.445376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2354e-7e03-4e49-b890-a644c14db4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.445707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2354e-7e03-4e49-b890-a644c14db4e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.446349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2354e-7e03-4e49-b890-a644c14db4e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:37.446649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2354e-7e03-4e49-b890-a644c14db4e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.448305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2354e-7e03-4e49-b890-a644c14db4e9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.454343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 790/1573] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:37.455689 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f80d-d497-404c-9cca-e734fdefc6dc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.469667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 784/1574] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:37.469667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2354e-7e03-4e49-b890-a644c14db4e9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.469963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f80d-d497-404c-9cca-e734fdefc6dc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.474442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d1ce6-6206-4805-bdee-62fc76e81be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.475086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d1ce6-6206-4805-bdee-62fc76e81be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.475365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d1ce6-6206-4805-bdee-62fc76e81be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.475641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d1ce6-6206-4805-bdee-62fc76e81be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.476672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d1ce6-6206-4805-bdee-62fc76e81be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.477564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2354e-7e03-4e49-b890-a644c14db4e9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.478188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d1ce6-6206-4805-bdee-62fc76e81be5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.482388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced427-3416-40e4-a9c6-54468cec501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.483202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced427-3416-40e4-a9c6-54468cec501a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.483484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced427-3416-40e4-a9c6-54468cec501a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.484217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced427-3416-40e4-a9c6-54468cec501a admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.484863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ced427-3416-40e4-a9c6-54468cec501a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.486827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ced427-3416-40e4-a9c6-54468cec501a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.507306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 791/1575] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.508362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d1ce6-6206-4805-bdee-62fc76e81be5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.517625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 785/1576] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.518458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced427-3416-40e4-a9c6-54468cec501a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.523945 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:37.562178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:37.569316 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d1ce6-6206-4805-bdee-62fc76e81be5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.583796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced427-3416-40e4-a9c6-54468cec501a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.588586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661091d1-b6b2-4c64-aca8-86fdbcd406fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.589086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661091d1-b6b2-4c64-aca8-86fdbcd406fe admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.589363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661091d1-b6b2-4c64-aca8-86fdbcd406fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.589637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661091d1-b6b2-4c64-aca8-86fdbcd406fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.590355 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661091d1-b6b2-4c64-aca8-86fdbcd406fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.592085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661091d1-b6b2-4c64-aca8-86fdbcd406fe admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.604826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 786/1577] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:37.604826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661091d1-b6b2-4c64-aca8-86fdbcd406fe admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.612792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661091d1-b6b2-4c64-aca8-86fdbcd406fe admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.617269 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b4ca-e5b0-48d3-a055-609728b7bac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.617474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04c512-d20a-4831-8a23-965b613db833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.617914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b4ca-e5b0-48d3-a055-609728b7bac4 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.618064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c512-d20a-4831-8a23-965b613db833 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.618206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b4ca-e5b0-48d3-a055-609728b7bac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.618305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c512-d20a-4831-8a23-965b613db833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.618453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b4ca-e5b0-48d3-a055-609728b7bac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.618560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c512-d20a-4831-8a23-965b613db833 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.619234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04c512-d20a-4831-8a23-965b613db833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.621113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04c512-d20a-4831-8a23-965b613db833 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.628265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239b4ca-e5b0-48d3-a055-609728b7bac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.629679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239b4ca-e5b0-48d3-a055-609728b7bac4 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.640550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 792/1578] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:37.641202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b4ca-e5b0-48d3-a055-609728b7bac4 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.643203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 787/1579] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.644112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04c512-d20a-4831-8a23-965b613db833 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.651487 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b4ca-e5b0-48d3-a055-609728b7bac4 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.656237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04c512-d20a-4831-8a23-965b613db833 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.656824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e622cfe-d82e-4d3e-aafa-69a9f1767f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.657832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e622cfe-d82e-4d3e-aafa-69a9f1767f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.658120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e622cfe-d82e-4d3e-aafa-69a9f1767f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.658490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e622cfe-d82e-4d3e-aafa-69a9f1767f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.659435 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e622cfe-d82e-4d3e-aafa-69a9f1767f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.661646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e7613-f430-4400-bec2-cd6dfefe0edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.661793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e622cfe-d82e-4d3e-aafa-69a9f1767f98 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.662426 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e7613-f430-4400-bec2-cd6dfefe0edd admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.662841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e7613-f430-4400-bec2-cd6dfefe0edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.663217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e7613-f430-4400-bec2-cd6dfefe0edd admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.663994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e7613-f430-4400-bec2-cd6dfefe0edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.666107 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e7613-f430-4400-bec2-cd6dfefe0edd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.677639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 793/1580] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:37.677639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e622cfe-d82e-4d3e-aafa-69a9f1767f98 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.687754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e622cfe-d82e-4d3e-aafa-69a9f1767f98 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.693151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c32ae3-2963-4594-b3cf-4a7dde0f3b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.693754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c32ae3-2963-4594-b3cf-4a7dde0f3b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.694030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c32ae3-2963-4594-b3cf-4a7dde0f3b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.694302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c32ae3-2963-4594-b3cf-4a7dde0f3b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.695008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c32ae3-2963-4594-b3cf-4a7dde0f3b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.697030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c32ae3-2963-4594-b3cf-4a7dde0f3b1c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.701636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 788/1581] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.701636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e7613-f430-4400-bec2-cd6dfefe0edd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.731556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 794/1582] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.733146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c32ae3-2963-4594-b3cf-4a7dde0f3b1c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.770981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e7613-f430-4400-bec2-cd6dfefe0edd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.810769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c32ae3-2963-4594-b3cf-4a7dde0f3b1c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.817083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f1bab-a0c5-4820-9cc5-572c1e32df03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.817959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f1bab-a0c5-4820-9cc5-572c1e32df03 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.818460 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f1bab-a0c5-4820-9cc5-572c1e32df03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.818925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f1bab-a0c5-4820-9cc5-572c1e32df03 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.819980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f1bab-a0c5-4820-9cc5-572c1e32df03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.822537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f1bab-a0c5-4820-9cc5-572c1e32df03 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.836202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05400a-9229-473e-ab36-d5c9d53f1c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.836912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05400a-9229-473e-ab36-d5c9d53f1c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.837268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05400a-9229-473e-ab36-d5c9d53f1c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.837603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05400a-9229-473e-ab36-d5c9d53f1c52 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.838543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05400a-9229-473e-ab36-d5c9d53f1c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.840677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05400a-9229-473e-ab36-d5c9d53f1c52 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.869543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 795/1583] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.869543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f1bab-a0c5-4820-9cc5-572c1e32df03 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.876441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 789/1584] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/users => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.877928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05400a-9229-473e-ab36-d5c9d53f1c52 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.884231 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f1bab-a0c5-4820-9cc5-572c1e32df03 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.889854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80638d-78a0-47a0-a511-16bac1eee84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.890538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80638d-78a0-47a0-a511-16bac1eee84b admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.890921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80638d-78a0-47a0-a511-16bac1eee84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.891258 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80638d-78a0-47a0-a511-16bac1eee84b admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.891977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80638d-78a0-47a0-a511-16bac1eee84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.893682 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80638d-78a0-47a0-a511-16bac1eee84b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.900106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05400a-9229-473e-ab36-d5c9d53f1c52 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.905804 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 796/1585] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:37.906818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80638d-78a0-47a0-a511-16bac1eee84b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.908049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47206e40-7b95-478b-a82c-182c5e8ef97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.909033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47206e40-7b95-478b-a82c-182c5e8ef97a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.909517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47206e40-7b95-478b-a82c-182c5e8ef97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.910204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47206e40-7b95-478b-a82c-182c5e8ef97a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.911208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47206e40-7b95-478b-a82c-182c5e8ef97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.913189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47206e40-7b95-478b-a82c-182c5e8ef97a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.917685 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80638d-78a0-47a0-a511-16bac1eee84b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.923799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35fa4-2945-43cb-9ab9-a8e29f434562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.924439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35fa4-2945-43cb-9ab9-a8e29f434562 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.924722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35fa4-2945-43cb-9ab9-a8e29f434562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.924996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35fa4-2945-43cb-9ab9-a8e29f434562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.926198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 790/1586] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:37.926334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb35fa4-2945-43cb-9ab9-a8e29f434562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.927958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb35fa4-2945-43cb-9ab9-a8e29f434562 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.930230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47206e40-7b95-478b-a82c-182c5e8ef97a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.942138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47206e40-7b95-478b-a82c-182c5e8ef97a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.942616 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 797/1587] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:37.943490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35fa4-2945-43cb-9ab9-a8e29f434562 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.947167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c21b36-47b0-4640-9a56-4411386977c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.947866 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21b36-47b0-4640-9a56-4411386977c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.948219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21b36-47b0-4640-9a56-4411386977c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.948675 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21b36-47b0-4640-9a56-4411386977c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.949260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c21b36-47b0-4640-9a56-4411386977c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.951901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c21b36-47b0-4640-9a56-4411386977c6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.955480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35fa4-2945-43cb-9ab9-a8e29f434562 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.960654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f115a-a387-4d97-92be-8ab64bb5bf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.961261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f115a-a387-4d97-92be-8ab64bb5bf64 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.961543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f115a-a387-4d97-92be-8ab64bb5bf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.961820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f115a-a387-4d97-92be-8ab64bb5bf64 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.962455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f115a-a387-4d97-92be-8ab64bb5bf64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.964479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f115a-a387-4d97-92be-8ab64bb5bf64 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.975172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:37.979133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 791/1588] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.979998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c21b36-47b0-4640-9a56-4411386977c6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.991824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.003044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 798/1589] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/users => generated 293 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:38.003044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f115a-a387-4d97-92be-8ab64bb5bf64 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.009800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c21b36-47b0-4640-9a56-4411386977c6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.014313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f115a-a387-4d97-92be-8ab64bb5bf64 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.018998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd1f70-8ea8-4ea3-9af7-20bc3728c7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.019332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbd255-f92a-4a53-8dad-9b58a332f664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.019645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd1f70-8ea8-4ea3-9af7-20bc3728c7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.019929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd1f70-8ea8-4ea3-9af7-20bc3728c7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.020048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbd255-f92a-4a53-8dad-9b58a332f664 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.020205 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd1f70-8ea8-4ea3-9af7-20bc3728c7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.020311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbd255-f92a-4a53-8dad-9b58a332f664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.020528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbd255-f92a-4a53-8dad-9b58a332f664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.020849 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd1f70-8ea8-4ea3-9af7-20bc3728c7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.021239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbd255-f92a-4a53-8dad-9b58a332f664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.022498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd1f70-8ea8-4ea3-9af7-20bc3728c7c5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.022803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbd255-f92a-4a53-8dad-9b58a332f664 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.036256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 799/1590] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:38.037124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbd255-f92a-4a53-8dad-9b58a332f664 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.039039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 792/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:38.040054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd1f70-8ea8-4ea3-9af7-20bc3728c7c5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.052166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbd255-f92a-4a53-8dad-9b58a332f664 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.052411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd1f70-8ea8-4ea3-9af7-20bc3728c7c5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.057508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07eac15-9b2f-4250-acd5-631a2d63c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.059244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07eac15-9b2f-4250-acd5-631a2d63c64c admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.059244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07eac15-9b2f-4250-acd5-631a2d63c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.059244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07eac15-9b2f-4250-acd5-631a2d63c64c admin admin] PATH_INFO: `/v3/projects/ce9d2fdd351e47948a9245f400c55990/users/f961b156bc31426abf95e303115be233/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.059663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eafd98-8c35-4a11-ad14-4971010485e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.060171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eafd98-8c35-4a11-ad14-4971010485e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.060638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eafd98-8c35-4a11-ad14-4971010485e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.060915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eafd98-8c35-4a11-ad14-4971010485e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.061615 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eafd98-8c35-4a11-ad14-4971010485e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.064553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eafd98-8c35-4a11-ad14-4971010485e0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.085588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07eac15-9b2f-4250-acd5-631a2d63c64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9d2fdd351e47948a9245f400c55990, user_id=f961b156bc31426abf95e303115be233, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.086580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 793/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:38.087649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eafd98-8c35-4a11-ad14-4971010485e0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.088778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-f07eac15-9b2f-4250-acd5-631a2d63c64c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:34:38.088778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: warnings.warn(msg) Oct 04 08:34:38.088778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: Oct 04 08:34:38.091426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07eac15-9b2f-4250-acd5-631a2d63c64c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.108421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eafd98-8c35-4a11-ad14-4971010485e0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.112679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 800/1593] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:38 2022] PUT /identity/v3/projects/ce9d2fdd351e47948a9245f400c55990/users/f961b156bc31426abf95e303115be233/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:38.113591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07eac15-9b2f-4250-acd5-631a2d63c64c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.185423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ce26-4b50-46bf-9464-1166ffb4b246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.186184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ce26-4b50-46bf-9464-1166ffb4b246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.186470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ce26-4b50-46bf-9464-1166ffb4b246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.186852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ce26-4b50-46bf-9464-1166ffb4b246 admin admin] PATH_INFO: `/v3/projects/637a13e73f5a4127a6b4b44d255e3473/users/9000009a061e4a12b37d591d72adc2a1/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.192674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07eac15-9b2f-4250-acd5-631a2d63c64c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.198227 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721228c3-5c72-4c6b-bd54-d93206fbb8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.199139 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721228c3-5c72-4c6b-bd54-d93206fbb8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.199462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721228c3-5c72-4c6b-bd54-d93206fbb8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.199736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721228c3-5c72-4c6b-bd54-d93206fbb8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.200383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721228c3-5c72-4c6b-bd54-d93206fbb8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.202148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721228c3-5c72-4c6b-bd54-d93206fbb8f9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.206306 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ce26-4b50-46bf-9464-1166ffb4b246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637a13e73f5a4127a6b4b44d255e3473, user_id=9000009a061e4a12b37d591d72adc2a1, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.209462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ce26-4b50-46bf-9464-1166ffb4b246 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.213524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 801/1594] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:38.214348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721228c3-5c72-4c6b-bd54-d93206fbb8f9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.225907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721228c3-5c72-4c6b-bd54-d93206fbb8f9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.241007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 794/1595] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:38 2022] PUT /identity/v3/projects/637a13e73f5a4127a6b4b44d255e3473/users/9000009a061e4a12b37d591d72adc2a1/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:38.241007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ce26-4b50-46bf-9464-1166ffb4b246 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.299173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d232293-e7c0-45f7-af68-7bf1f25b324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.300362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232293-e7c0-45f7-af68-7bf1f25b324f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.300975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232293-e7c0-45f7-af68-7bf1f25b324f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.301590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232293-e7c0-45f7-af68-7bf1f25b324f admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.302835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d232293-e7c0-45f7-af68-7bf1f25b324f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.309072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d232293-e7c0-45f7-af68-7bf1f25b324f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.309191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ce26-4b50-46bf-9464-1166ffb4b246 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.312243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ae2a5-5d74-430a-8767-32ab833fc3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.312950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ae2a5-5d74-430a-8767-32ab833fc3ca admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.313323 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ae2a5-5d74-430a-8767-32ab833fc3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.313700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ae2a5-5d74-430a-8767-32ab833fc3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.314434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ae2a5-5d74-430a-8767-32ab833fc3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.316218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ae2a5-5d74-430a-8767-32ab833fc3ca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.327385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 802/1596] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:38.327385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d232293-e7c0-45f7-af68-7bf1f25b324f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.334490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 795/1597] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:38.334490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ae2a5-5d74-430a-8767-32ab833fc3ca admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.338497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d232293-e7c0-45f7-af68-7bf1f25b324f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.345431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d155a-bdb8-49de-a066-b1bd75dc0982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.346328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d155a-bdb8-49de-a066-b1bd75dc0982 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.346612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d155a-bdb8-49de-a066-b1bd75dc0982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.346909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d155a-bdb8-49de-a066-b1bd75dc0982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.347552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d155a-bdb8-49de-a066-b1bd75dc0982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.348863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ae2a5-5d74-430a-8767-32ab833fc3ca admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.349144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d155a-bdb8-49de-a066-b1bd75dc0982 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.356108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4d78-860a-43bb-b0c5-aa0c4ecc53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.357127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4d78-860a-43bb-b0c5-aa0c4ecc53aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.357530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4d78-860a-43bb-b0c5-aa0c4ecc53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.358451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4d78-860a-43bb-b0c5-aa0c4ecc53aa admin admin] PATH_INFO: `/v3/projects/bfe7b6d3ff8c473b9dc21037ee8e4248/users/50403e9f6fe74521823771d7d661dc85/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.364958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 803/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:38.368686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c069b-3b72-44c8-8dcf-08e28145cea5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.369279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c069b-3b72-44c8-8dcf-08e28145cea5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.369701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c069b-3b72-44c8-8dcf-08e28145cea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.379782 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db4d78-860a-43bb-b0c5-aa0c4ecc53aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe7b6d3ff8c473b9dc21037ee8e4248, user_id=50403e9f6fe74521823771d7d661dc85, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.382995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db4d78-860a-43bb-b0c5-aa0c4ecc53aa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.396685 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6c4c069b-3b72-44c8-8dcf-08e28145cea5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:38.398121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6c4c069b-3b72-44c8-8dcf-08e28145cea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:38.401753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 796/1599] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:38 2022] PUT /identity/v3/projects/bfe7b6d3ff8c473b9dc21037ee8e4248/users/50403e9f6fe74521823771d7d661dc85/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:38.402969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4d78-860a-43bb-b0c5-aa0c4ecc53aa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.447631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.464860 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.497331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 804/1600] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:38.505211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44817d-d78e-49c2-b10f-b86f9317a19a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.505503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44817d-d78e-49c2-b10f-b86f9317a19a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.506234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44817d-d78e-49c2-b10f-b86f9317a19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.508955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4d78-860a-43bb-b0c5-aa0c4ecc53aa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.531013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3906b-d83f-4e13-a9f4-ec287140b6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.531739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3906b-d83f-4e13-a9f4-ec287140b6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.532020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3906b-d83f-4e13-a9f4-ec287140b6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.532296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3906b-d83f-4e13-a9f4-ec287140b6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.532946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3906b-d83f-4e13-a9f4-ec287140b6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.538631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3906b-d83f-4e13-a9f4-ec287140b6fb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.543682 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1d44817d-d78e-49c2-b10f-b86f9317a19a None None] MFA Rules not processed for user `9000009a061e4a12b37d591d72adc2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:38.545183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1d44817d-d78e-49c2-b10f-b86f9317a19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:38.558246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 797/1601] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:38.559940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3906b-d83f-4e13-a9f4-ec287140b6fb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.572471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3906b-d83f-4e13-a9f4-ec287140b6fb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.585731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da4ef-a8ed-410c-9811-cee38ec14f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.586349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da4ef-a8ed-410c-9811-cee38ec14f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.586622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da4ef-a8ed-410c-9811-cee38ec14f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.586916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da4ef-a8ed-410c-9811-cee38ec14f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.587564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da4ef-a8ed-410c-9811-cee38ec14f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.591556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da4ef-a8ed-410c-9811-cee38ec14f38 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.613488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 798/1602] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:38.614184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da4ef-a8ed-410c-9811-cee38ec14f38 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.627990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da4ef-a8ed-410c-9811-cee38ec14f38 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.633883 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a642-10c3-42dc-865a-fbbe61fb686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.634599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a642-10c3-42dc-865a-fbbe61fb686e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.634919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a642-10c3-42dc-865a-fbbe61fb686e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.635226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a642-10c3-42dc-865a-fbbe61fb686e admin admin] PATH_INFO: `/v3/projects/46dddbfeb66442cfadacd00f8fae9aa8/users/fa9409e218c842f4a7ca1cae57a699f1/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.653258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a642-10c3-42dc-865a-fbbe61fb686e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46dddbfeb66442cfadacd00f8fae9aa8, user_id=fa9409e218c842f4a7ca1cae57a699f1, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.656492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a642-10c3-42dc-865a-fbbe61fb686e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.661484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 805/1603] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:38.662779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44817d-d78e-49c2-b10f-b86f9317a19a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.676853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 799/1604] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:38 2022] PUT /identity/v3/projects/46dddbfeb66442cfadacd00f8fae9aa8/users/fa9409e218c842f4a7ca1cae57a699f1/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:38.677012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44817d-d78e-49c2-b10f-b86f9317a19a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.678543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74ecfc-8478-44d1-aa1e-5d102df69a03 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.679007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74ecfc-8478-44d1-aa1e-5d102df69a03 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.679612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74ecfc-8478-44d1-aa1e-5d102df69a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.728548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7d74ecfc-8478-44d1-aa1e-5d102df69a03 None None] MFA Rules not processed for user `50403e9f6fe74521823771d7d661dc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:38.730218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7d74ecfc-8478-44d1-aa1e-5d102df69a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:38.769642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217de19-c298-4813-b737-9fb6dffa5d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.770367 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217de19-c298-4813-b737-9fb6dffa5d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.771193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217de19-c298-4813-b737-9fb6dffa5d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.771548 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217de19-c298-4813-b737-9fb6dffa5d76 admin admin] PATH_INFO: `/v3/projects/17afe680a48e4bac8ba0f2bfc7b4eb87/users/89745e9f5689415ab763980f222fe682/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.792303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217de19-c298-4813-b737-9fb6dffa5d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17afe680a48e4bac8ba0f2bfc7b4eb87, user_id=89745e9f5689415ab763980f222fe682, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.795652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217de19-c298-4813-b737-9fb6dffa5d76 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.815379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 806/1605] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:38 2022] PUT /identity/v3/projects/17afe680a48e4bac8ba0f2bfc7b4eb87/users/89745e9f5689415ab763980f222fe682/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:38.816361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217de19-c298-4813-b737-9fb6dffa5d76 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.818889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 800/1606] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:38.819644 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74ecfc-8478-44d1-aa1e-5d102df69a03 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.838204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74ecfc-8478-44d1-aa1e-5d102df69a03 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.888712 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.893978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217de19-c298-4813-b737-9fb6dffa5d76 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.899728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bae30-5e46-4f54-8c55-60aca2440b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.900613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bae30-5e46-4f54-8c55-60aca2440b34 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.901003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bae30-5e46-4f54-8c55-60aca2440b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.901602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bae30-5e46-4f54-8c55-60aca2440b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.920651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c32c4a-29c3-45bb-baa7-66c57298f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.921466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c32c4a-29c3-45bb-baa7-66c57298f32f admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.922052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c32c4a-29c3-45bb-baa7-66c57298f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.922052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c32c4a-29c3-45bb-baa7-66c57298f32f admin admin] PATH_INFO: `/v3/projects/e55e8ca130b948c992c796c3329ad1c8/users/96219eb4a7d649848ee4e700ae7a65f0/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.944592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c32c4a-29c3-45bb-baa7-66c57298f32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55e8ca130b948c992c796c3329ad1c8, user_id=96219eb4a7d649848ee4e700ae7a65f0, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.947684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c32c4a-29c3-45bb-baa7-66c57298f32f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.971817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 801/1607] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:38 2022] PUT /identity/v3/projects/e55e8ca130b948c992c796c3329ad1c8/users/96219eb4a7d649848ee4e700ae7a65f0/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:38.976836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c32c4a-29c3-45bb-baa7-66c57298f32f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.989565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bae30-5e46-4f54-8c55-60aca2440b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.991274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bae30-5e46-4f54-8c55-60aca2440b34 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.991566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:39.007183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 807/1608] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:39.008376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bae30-5e46-4f54-8c55-60aca2440b34 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:39.083981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c32c4a-29c3-45bb-baa7-66c57298f32f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:39.098272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f1d2c-d80d-4d6d-ad55-64035dffbd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:39.099603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f1d2c-d80d-4d6d-ad55-64035dffbd85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.102628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f1d2c-d80d-4d6d-ad55-64035dffbd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.103063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f1d2c-d80d-4d6d-ad55-64035dffbd85 admin admin] PATH_INFO: `/v3/projects/f3b203e32fe74e9b97e28c1daaf1941c/users/e9393dcab2a541c8a4468cc7e8ff7cd7/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.125168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bae30-5e46-4f54-8c55-60aca2440b34 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:39.136483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f1d2c-d80d-4d6d-ad55-64035dffbd85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b203e32fe74e9b97e28c1daaf1941c, user_id=e9393dcab2a541c8a4468cc7e8ff7cd7, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:39.142148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f1d2c-d80d-4d6d-ad55-64035dffbd85 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:39.168605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 802/1609] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:38 2022] PUT /identity/v3/projects/f3b203e32fe74e9b97e28c1daaf1941c/users/e9393dcab2a541c8a4468cc7e8ff7cd7/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:39.170806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb770-041e-4d41-b19a-ee747a53ad5f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.171104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb770-041e-4d41-b19a-ee747a53ad5f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.171385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb770-041e-4d41-b19a-ee747a53ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.240357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154ffca-ff8c-4c90-9710-24be15646a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:39.241328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ffca-ff8c-4c90-9710-24be15646a40 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.241610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ffca-ff8c-4c90-9710-24be15646a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.241982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ffca-ff8c-4c90-9710-24be15646a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.251409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9cffb770-041e-4d41-b19a-ee747a53ad5f None None] MFA Rules not processed for user `fa9409e218c842f4a7ca1cae57a699f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:39.253097 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9cffb770-041e-4d41-b19a-ee747a53ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:39.402076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 803/1610] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:39.402076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb770-041e-4d41-b19a-ee747a53ad5f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:39.405477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154ffca-ff8c-4c90-9710-24be15646a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:39.407744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154ffca-ff8c-4c90-9710-24be15646a40 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:39.422452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 808/1611] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:39.425757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c342c-2b87-4e91-ab2d-7f0beb1422ba None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.427894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c342c-2b87-4e91-ab2d-7f0beb1422ba None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.429173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c342c-2b87-4e91-ab2d-7f0beb1422ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.478751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2e8c342c-2b87-4e91-ab2d-7f0beb1422ba None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:39.483447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2e8c342c-2b87-4e91-ab2d-7f0beb1422ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:39.490621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:39.620001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb770-041e-4d41-b19a-ee747a53ad5f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:39.627012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b657d-a537-4ee2-8100-c511a393845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:39.627886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 809/1612] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:39.629376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362af09c-5c7d-4c6c-9438-272ae4ce2cc9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.629692 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362af09c-5c7d-4c6c-9438-272ae4ce2cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.630963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b657d-a537-4ee2-8100-c511a393845b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.631268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b657d-a537-4ee2-8100-c511a393845b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.631377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362af09c-5c7d-4c6c-9438-272ae4ce2cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.631544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b657d-a537-4ee2-8100-c511a393845b admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.632447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b657d-a537-4ee2-8100-c511a393845b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:39.637332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b657d-a537-4ee2-8100-c511a393845b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:39.683025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-362af09c-5c7d-4c6c-9438-272ae4ce2cc9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:39.684956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-362af09c-5c7d-4c6c-9438-272ae4ce2cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:39.706062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 810/1613] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:39.707533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10561899-17c4-4209-acba-cc9a273b9094 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.707824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10561899-17c4-4209-acba-cc9a273b9094 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.708099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10561899-17c4-4209-acba-cc9a273b9094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.717100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 804/1614] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:39 2022] POST /identity/v3/projects => generated 369 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:39.718027 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b657d-a537-4ee2-8100-c511a393845b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:39.743489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:39.777158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-10561899-17c4-4209-acba-cc9a273b9094 None None] MFA Rules not processed for user `e9393dcab2a541c8a4468cc7e8ff7cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:39.778661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-10561899-17c4-4209-acba-cc9a273b9094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:39.867848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 811/1615] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:39.868733 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10561899-17c4-4209-acba-cc9a273b9094 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:39.884211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b657d-a537-4ee2-8100-c511a393845b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:39.906552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be7709-972c-4203-978f-40c5228e3714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:39.907206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be7709-972c-4203-978f-40c5228e3714 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.907489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be7709-972c-4203-978f-40c5228e3714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.907781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be7709-972c-4203-978f-40c5228e3714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.908413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be7709-972c-4203-978f-40c5228e3714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:39.920833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be7709-972c-4203-978f-40c5228e3714 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:39.941333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10561899-17c4-4209-acba-cc9a273b9094 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:39.956348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e121c-5f1b-4cc6-a269-5526b3ddda6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:39.957181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e121c-5f1b-4cc6-a269-5526b3ddda6b service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.957514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e121c-5f1b-4cc6-a269-5526b3ddda6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.957722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e121c-5f1b-4cc6-a269-5526b3ddda6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.983992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 805/1616] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:39 2022] POST /identity/v3/projects => generated 403 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:39.984883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e121c-5f1b-4cc6-a269-5526b3ddda6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:39.985191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be7709-972c-4203-978f-40c5228e3714 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:39.986379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e121c-5f1b-4cc6-a269-5526b3ddda6b service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.007643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 812/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:40.008562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e121c-5f1b-4cc6-a269-5526b3ddda6b service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.019724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e121c-5f1b-4cc6-a269-5526b3ddda6b service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.074264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:40.108133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc942e-7598-438b-ac33-51530cbfe0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.108765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc942e-7598-438b-ac33-51530cbfe0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.109455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc942e-7598-438b-ac33-51530cbfe0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.109877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc942e-7598-438b-ac33-51530cbfe0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.125680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be7709-972c-4203-978f-40c5228e3714 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.131223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc942e-7598-438b-ac33-51530cbfe0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.133582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f486ff4-154b-4ca2-9ee0-5c062ee114e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.134398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f486ff4-154b-4ca2-9ee0-5c062ee114e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.134800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f486ff4-154b-4ca2-9ee0-5c062ee114e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.135169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f486ff4-154b-4ca2-9ee0-5c062ee114e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.135865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc942e-7598-438b-ac33-51530cbfe0a9 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.136519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f486ff4-154b-4ca2-9ee0-5c062ee114e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.139052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f486ff4-154b-4ca2-9ee0-5c062ee114e2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.172036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 813/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:40.173422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb958-a5da-43e6-8d16-77b15e2a0c42 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.173709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb958-a5da-43e6-8d16-77b15e2a0c42 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.173985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb958-a5da-43e6-8d16-77b15e2a0c42 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.179748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 806/1619] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:39 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:40.181142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f486ff4-154b-4ca2-9ee0-5c062ee114e2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.183041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 814/1620] 10.222.0.23 () {54 vars in 961 bytes} [Tue Oct 4 08:34:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:40.183952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb958-a5da-43e6-8d16-77b15e2a0c42 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.203319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f486ff4-154b-4ca2-9ee0-5c062ee114e2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.213116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb958-a5da-43e6-8d16-77b15e2a0c42 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.213792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d4f4b-3565-4e6f-8a9e-930f4685c658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.214769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d4f4b-3565-4e6f-8a9e-930f4685c658 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.217151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d4f4b-3565-4e6f-8a9e-930f4685c658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.217151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d4f4b-3565-4e6f-8a9e-930f4685c658 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.217976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d4f4b-3565-4e6f-8a9e-930f4685c658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.220588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d4f4b-3565-4e6f-8a9e-930f4685c658 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.225532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad391a-7ecb-41ce-80df-3bc7027e3b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.226153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad391a-7ecb-41ce-80df-3bc7027e3b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.226439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad391a-7ecb-41ce-80df-3bc7027e3b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.226772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad391a-7ecb-41ce-80df-3bc7027e3b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.227382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad391a-7ecb-41ce-80df-3bc7027e3b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.229128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad391a-7ecb-41ce-80df-3bc7027e3b8e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.260867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 815/1621] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:40.264078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db098ed-c6df-4d52-b56d-b7a5b25a340f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.264494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db098ed-c6df-4d52-b56d-b7a5b25a340f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.264697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db098ed-c6df-4d52-b56d-b7a5b25a340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.286915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 807/1622] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:40 2022] POST /identity/v3/users => generated 308 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:40.287901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d4f4b-3565-4e6f-8a9e-930f4685c658 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.324191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d4f4b-3565-4e6f-8a9e-930f4685c658 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.341187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bf285-3db8-477d-80cc-bd425e9e8e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.341886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bf285-3db8-477d-80cc-bd425e9e8e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.342170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bf285-3db8-477d-80cc-bd425e9e8e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.342447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bf285-3db8-477d-80cc-bd425e9e8e96 admin admin] PATH_INFO: `/v3/projects/03193a8044e84f47999ecdc389cfda18/users/3643459bb30140bb9432a0d71af0cb16/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.373216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1db098ed-c6df-4d52-b56d-b7a5b25a340f None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:40.375471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1db098ed-c6df-4d52-b56d-b7a5b25a340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:40.389637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bf285-3db8-477d-80cc-bd425e9e8e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03193a8044e84f47999ecdc389cfda18, user_id=3643459bb30140bb9432a0d71af0cb16, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.392492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bf285-3db8-477d-80cc-bd425e9e8e96 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.419606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 808/1623] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:40 2022] PUT /identity/v3/projects/03193a8044e84f47999ecdc389cfda18/users/3643459bb30140bb9432a0d71af0cb16/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:40.420323 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bf285-3db8-477d-80cc-bd425e9e8e96 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.606540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:40.647469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 816/1624] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Oct 4 08:34:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:40.660484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db098ed-c6df-4d52-b56d-b7a5b25a340f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.673632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bf285-3db8-477d-80cc-bd425e9e8e96 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.691755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900e24f-12cb-4cd1-892f-db6e5bab613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.703535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900e24f-12cb-4cd1-892f-db6e5bab613b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.703535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900e24f-12cb-4cd1-892f-db6e5bab613b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.704009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db098ed-c6df-4d52-b56d-b7a5b25a340f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.704121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900e24f-12cb-4cd1-892f-db6e5bab613b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.704121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900e24f-12cb-4cd1-892f-db6e5bab613b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.704121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900e24f-12cb-4cd1-892f-db6e5bab613b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.708535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b50f7-65be-48f7-9744-23125f20fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.712407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b50f7-65be-48f7-9744-23125f20fd95 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.712856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b50f7-65be-48f7-9744-23125f20fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.714317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b50f7-65be-48f7-9744-23125f20fd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.716479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b50f7-65be-48f7-9744-23125f20fd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.724634 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b50f7-65be-48f7-9744-23125f20fd95 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.745642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 809/1625] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:40.749707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900e24f-12cb-4cd1-892f-db6e5bab613b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.771070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 817/1626] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:40.772731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b50f7-65be-48f7-9744-23125f20fd95 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.807884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b50f7-65be-48f7-9744-23125f20fd95 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.827201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082989c-2313-4635-b147-4d969111744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.828945 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082989c-2313-4635-b147-4d969111744d admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.831593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082989c-2313-4635-b147-4d969111744d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.832292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082989c-2313-4635-b147-4d969111744d admin admin] PATH_INFO: `/v3/projects/1a9edf45959843a8b20b58e57f34c03c/users/5278c8fd9427408685b1982d18f2bc70/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.887250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082989c-2313-4635-b147-4d969111744d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9edf45959843a8b20b58e57f34c03c, user_id=5278c8fd9427408685b1982d18f2bc70, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.891845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082989c-2313-4635-b147-4d969111744d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.925389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 818/1627] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:40 2022] PUT /identity/v3/projects/1a9edf45959843a8b20b58e57f34c03c/users/5278c8fd9427408685b1982d18f2bc70/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:40.928335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082989c-2313-4635-b147-4d969111744d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.003050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900e24f-12cb-4cd1-892f-db6e5bab613b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.099599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082989c-2313-4635-b147-4d969111744d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.112589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8ab05-44b4-41b7-885e-7b1e7ab4df06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.113838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8ab05-44b4-41b7-885e-7b1e7ab4df06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.114192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8ab05-44b4-41b7-885e-7b1e7ab4df06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.114473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8ab05-44b4-41b7-885e-7b1e7ab4df06 admin admin] PATH_INFO: `/v3/projects/03193a8044e84f47999ecdc389cfda18/users/3643459bb30140bb9432a0d71af0cb16/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.120326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8ab05-44b4-41b7-885e-7b1e7ab4df06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03193a8044e84f47999ecdc389cfda18, user_id=3643459bb30140bb9432a0d71af0cb16, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:41.131347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8ab05-44b4-41b7-885e-7b1e7ab4df06 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:41.144923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffab4fc-b643-4989-bb1c-403045533137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.147321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffab4fc-b643-4989-bb1c-403045533137 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.147321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffab4fc-b643-4989-bb1c-403045533137 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.147321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffab4fc-b643-4989-bb1c-403045533137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.157367 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 819/1628] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:40 2022] PUT /identity/v3/projects/03193a8044e84f47999ecdc389cfda18/users/3643459bb30140bb9432a0d71af0cb16/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:41.158992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8ab05-44b4-41b7-885e-7b1e7ab4df06 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.167801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:41.294277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8ab05-44b4-41b7-885e-7b1e7ab4df06 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.306203 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bad73e-3549-427d-9690-7ea6c757a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.309221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bad73e-3549-427d-9690-7ea6c757a886 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.309515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bad73e-3549-427d-9690-7ea6c757a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.309792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bad73e-3549-427d-9690-7ea6c757a886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.310168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffab4fc-b643-4989-bb1c-403045533137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:41.312799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffab4fc-b643-4989-bb1c-403045533137 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:41.313044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bad73e-3549-427d-9690-7ea6c757a886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:41.319104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bad73e-3549-427d-9690-7ea6c757a886 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:41.336752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 810/1629] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:41.340086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8253-bae6-4e9f-9fbf-a997b847a2a0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.342818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8253-bae6-4e9f-9fbf-a997b847a2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.343046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8253-bae6-4e9f-9fbf-a997b847a2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.348452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 820/1630] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:41.350266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bad73e-3549-427d-9690-7ea6c757a886 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.370786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bad73e-3549-427d-9690-7ea6c757a886 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.390302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b10c4f-22de-4207-9ef6-2843dfeae4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.391354 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b10c4f-22de-4207-9ef6-2843dfeae4e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.391637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b10c4f-22de-4207-9ef6-2843dfeae4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.391913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b10c4f-22de-4207-9ef6-2843dfeae4e1 admin admin] PATH_INFO: `/v3/projects/1a9edf45959843a8b20b58e57f34c03c/users/5278c8fd9427408685b1982d18f2bc70/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.398563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b10c4f-22de-4207-9ef6-2843dfeae4e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9edf45959843a8b20b58e57f34c03c, user_id=5278c8fd9427408685b1982d18f2bc70, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:41.398823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:41.401213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b10c4f-22de-4207-9ef6-2843dfeae4e1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:41.408757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-55cf8253-bae6-4e9f-9fbf-a997b847a2a0 None None] MFA Rules not processed for user `3643459bb30140bb9432a0d71af0cb16`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:41.410248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-55cf8253-bae6-4e9f-9fbf-a997b847a2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:41.436435 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 821/1631] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:41 2022] PUT /identity/v3/projects/1a9edf45959843a8b20b58e57f34c03c/users/5278c8fd9427408685b1982d18f2bc70/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:41.437332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b1290-b8ad-4eab-8aab-51d93724868f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.438496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b1290-b8ad-4eab-8aab-51d93724868f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.438496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b1290-b8ad-4eab-8aab-51d93724868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.530028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e91b1290-b8ad-4eab-8aab-51d93724868f None None] MFA Rules not processed for user `5278c8fd9427408685b1982d18f2bc70`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:41.531617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e91b1290-b8ad-4eab-8aab-51d93724868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:41.595809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 811/1632] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:41.611270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8253-bae6-4e9f-9fbf-a997b847a2a0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.659064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 822/1633] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:41 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:34:41.669150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b1290-b8ad-4eab-8aab-51d93724868f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.721215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8253-bae6-4e9f-9fbf-a997b847a2a0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.767934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b1290-b8ad-4eab-8aab-51d93724868f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.777881 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3985613-ec7b-4511-a1fe-881a403d750b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.778838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3985613-ec7b-4511-a1fe-881a403d750b service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.779284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3985613-ec7b-4511-a1fe-881a403d750b service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.779704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3985613-ec7b-4511-a1fe-881a403d750b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.790089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8087570-5c40-4eff-a746-e486dd9ffee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.790739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8087570-5c40-4eff-a746-e486dd9ffee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.791023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8087570-5c40-4eff-a746-e486dd9ffee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.791295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8087570-5c40-4eff-a746-e486dd9ffee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.807163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3985613-ec7b-4511-a1fe-881a403d750b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:41.808999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3985613-ec7b-4511-a1fe-881a403d750b service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:41.830736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 823/1634] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:41 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:34:41.868445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8087570-5c40-4eff-a746-e486dd9ffee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:41.870089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8087570-5c40-4eff-a746-e486dd9ffee2 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:41.895102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 812/1635] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:34:41.896287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba55a-b1dd-40a3-a27f-ece6490fd8e7 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.896750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba55a-b1dd-40a3-a27f-ece6490fd8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.897157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba55a-b1dd-40a3-a27f-ece6490fd8e7 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.898833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 824/1636] 10.222.0.23 () {54 vars in 912 bytes} [Tue Oct 4 08:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:41.905447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb2fed-5cf0-4733-af34-9ff92ba0a6f0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.905844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb2fed-5cf0-4733-af34-9ff92ba0a6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.906123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb2fed-5cf0-4733-af34-9ff92ba0a6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.920557 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:41.945115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-39bb2fed-5cf0-4733-af34-9ff92ba0a6f0 None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:41.948526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-39bb2fed-5cf0-4733-af34-9ff92ba0a6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:41.981550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba55a-b1dd-40a3-a27f-ece6490fd8e7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.995819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba55a-b1dd-40a3-a27f-ece6490fd8e7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:42.004638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b34616-8263-4103-b1e3-107e7c5cfc4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:42.006076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b34616-8263-4103-b1e3-107e7c5cfc4a service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.006604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b34616-8263-4103-b1e3-107e7c5cfc4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.007121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b34616-8263-4103-b1e3-107e7c5cfc4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.030794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:42.138542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b34616-8263-4103-b1e3-107e7c5cfc4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:42.140160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b34616-8263-4103-b1e3-107e7c5cfc4a service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:42.154954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 813/1637] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:34:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:42.161228 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 825/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:42.197249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb2fed-5cf0-4733-af34-9ff92ba0a6f0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:42.209738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb2fed-5cf0-4733-af34-9ff92ba0a6f0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:42.224993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c739dfa-6bb1-4132-bb82-5f6dd847605f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:42.226523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739dfa-6bb1-4132-bb82-5f6dd847605f service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.227412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739dfa-6bb1-4132-bb82-5f6dd847605f service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.228647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739dfa-6bb1-4132-bb82-5f6dd847605f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.256392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c739dfa-6bb1-4132-bb82-5f6dd847605f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:42.259085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c739dfa-6bb1-4132-bb82-5f6dd847605f service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:42.307760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 814/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:34:42.693216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1107-9fee-42b1-a50b-020dcc589447 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.694246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1107-9fee-42b1-a50b-020dcc589447 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.694720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1107-9fee-42b1-a50b-020dcc589447 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.696377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 826/1640] 10.222.0.23 () {54 vars in 961 bytes} [Tue Oct 4 08:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:42.719231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b64f98-022f-4dda-ab21-20764f70c27f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.720739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b64f98-022f-4dda-ab21-20764f70c27f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.721393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b64f98-022f-4dda-ab21-20764f70c27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.772614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e4b64f98-022f-4dda-ab21-20764f70c27f None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:42.773869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e4b64f98-022f-4dda-ab21-20764f70c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:42.801818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 815/1641] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Oct 4 08:34:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:42.803305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e90a5-1787-4143-9911-801a815c5237 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.803834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e90a5-1787-4143-9911-801a815c5237 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.804328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e90a5-1787-4143-9911-801a815c5237 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.805928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 827/1642] 10.222.0.23 () {54 vars in 912 bytes} [Tue Oct 4 08:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:42.819247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b81c-a269-40ce-9f46-5b39458a1e84 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.819529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b81c-a269-40ce-9f46-5b39458a1e84 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.819884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b81c-a269-40ce-9f46-5b39458a1e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.888246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ccd1b81c-a269-40ce-9f46-5b39458a1e84 None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:42.889504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ccd1b81c-a269-40ce-9f46-5b39458a1e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:42.926892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 816/1643] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:34:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:43.055260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e90a5-1787-4143-9911-801a815c5237 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.065062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1b81c-a269-40ce-9f46-5b39458a1e84 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.113696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1b81c-a269-40ce-9f46-5b39458a1e84 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.113696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b0aa0-618e-4bfb-bc44-992cd1165a2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.113696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b0aa0-618e-4bfb-bc44-992cd1165a2d service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.113696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b0aa0-618e-4bfb-bc44-992cd1165a2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.114592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b0aa0-618e-4bfb-bc44-992cd1165a2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.139630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b0aa0-618e-4bfb-bc44-992cd1165a2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.141341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b0aa0-618e-4bfb-bc44-992cd1165a2d service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.172357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 817/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:34:43.286483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e90a5-1787-4143-9911-801a815c5237 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.302337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.303175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.304189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.305272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] PATH_INFO: `/v3/users/fa9409e218c842f4a7ca1cae57a699f1` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.310302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa9409e218c842f4a7ca1cae57a699f1)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.311903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: WARNING py.warnings [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:34:43.311903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: warnings.warn(msg) Oct 04 08:34:43.311903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: Oct 04 08:34:43.313898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.500827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa9409e218c842f4a7ca1cae57a699f1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:43.501653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa9409e218c842f4a7ca1cae57a699f1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:43.552908 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa9409e218c842f4a7ca1cae57a699f1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:43.572487 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa9409e218c842f4a7ca1cae57a699f1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:43.577007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa9409e218c842f4a7ca1cae57a699f1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:43.601296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 828/1645] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:34:43 2022] DELETE /identity/v3/users/fa9409e218c842f4a7ca1cae57a699f1 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:43.607232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e005b0-b643-4a97-991a-2066062320c5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.607232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e005b0-b643-4a97-991a-2066062320c5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.607568 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e005b0-b643-4a97-991a-2066062320c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.648831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-20e005b0-b643-4a97-991a-2066062320c5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:43.650078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-20e005b0-b643-4a97-991a-2066062320c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:43.792120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 818/1646] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:43.808438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.810097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:43.924799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:44.023594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47eeab8-37f6-48fa-b47e-7bb2e99e8520 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:44.034061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fda38-a20c-4f0a-b7ea-e18b73b0e644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:44.035063 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fda38-a20c-4f0a-b7ea-e18b73b0e644 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:44.036776 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fda38-a20c-4f0a-b7ea-e18b73b0e644 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:44.037134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fda38-a20c-4f0a-b7ea-e18b73b0e644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:44.075498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fda38-a20c-4f0a-b7ea-e18b73b0e644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:44.077071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fda38-a20c-4f0a-b7ea-e18b73b0e644 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:44.114778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 829/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:46.585095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e005b0-b643-4a97-991a-2066062320c5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:46.590456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-20e005b0-b643-4a97-991a-2066062320c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:46.610793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e005b0-b643-4a97-991a-2066062320c5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:46.622692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:46.624591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:46.624888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:46.626550 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] PATH_INFO: `/v3/projects/46dddbfeb66442cfadacd00f8fae9aa8` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:46.636174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46dddbfeb66442cfadacd00f8fae9aa8)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:46.640476 dv-cinder-860209-1-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:34:46.640476 dv-cinder-860209-1-smb devstack@keystone.service[81398]: warnings.warn(msg) Oct 04 08:34:46.640476 dv-cinder-860209-1-smb devstack@keystone.service[81398]: Oct 04 08:34:46.644310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:46.803924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46dddbfeb66442cfadacd00f8fae9aa8', 'request_id': 'req-fcca497e-d935-4e02-b2f3-dba0e86b2691'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:46.807950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:46.814942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46dddbfeb66442cfadacd00f8fae9aa8', 'request_id': 'req-fcca497e-d935-4e02-b2f3-dba0e86b2691'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:46.832695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46dddbfeb66442cfadacd00f8fae9aa8', 'request_id': 'req-fcca497e-d935-4e02-b2f3-dba0e86b2691'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:46.883041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] The token cache is being invalidate because project 46dddbfeb66442cfadacd00f8fae9aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:34:46.883237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:46.885167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:46.890843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 819/1648] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:34:46 2022] DELETE /identity/v3/projects/46dddbfeb66442cfadacd00f8fae9aa8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:46.892147 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fda38-a20c-4f0a-b7ea-e18b73b0e644 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:46.905240 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fda38-a20c-4f0a-b7ea-e18b73b0e644 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.023659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.024332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.024615 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.024892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] PATH_INFO: `/v3/users/5278c8fd9427408685b1982d18f2bc70` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.030396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5278c8fd9427408685b1982d18f2bc70)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.032473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.145902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5278c8fd9427408685b1982d18f2bc70'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:47.151306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5278c8fd9427408685b1982d18f2bc70'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:47.168868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5278c8fd9427408685b1982d18f2bc70'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:47.178444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5278c8fd9427408685b1982d18f2bc70'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:47.179477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5278c8fd9427408685b1982d18f2bc70'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:47.213771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 830/1649] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:34:46 2022] DELETE /identity/v3/users/5278c8fd9427408685b1982d18f2bc70 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:48.590787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:48.592787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:48.619482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca497e-d935-4e02-b2f3-dba0e86b2691 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:48.776265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:48.777927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:48.778504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:48.779010 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] PATH_INFO: `/v3/users/50403e9f6fe74521823771d7d661dc85` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:48.783118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50403e9f6fe74521823771d7d661dc85)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:48.788736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:48.918162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50403e9f6fe74521823771d7d661dc85'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:48.921875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50403e9f6fe74521823771d7d661dc85'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:48.941790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50403e9f6fe74521823771d7d661dc85'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:48.943581 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50403e9f6fe74521823771d7d661dc85'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:48.956640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:48.959461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:48.974664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-128ff584-c1f5-4738-b3ff-f58bdb7d62e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50403e9f6fe74521823771d7d661dc85'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:48.977079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0e7c-bfdf-49d5-82a9-4709c3c0b9e7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:48.984015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:48.985011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:48.985529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:48.986046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] PATH_INFO: `/v3/projects/1a9edf45959843a8b20b58e57f34c03c` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:48.987681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9edf45959843a8b20b58e57f34c03c)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:48.991109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:49.005068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 820/1650] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:34:48 2022] DELETE /identity/v3/users/50403e9f6fe74521823771d7d661dc85 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:49.009151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f092d-079a-40c3-8ed4-aabbb0782ffe None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:49.009495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f092d-079a-40c3-8ed4-aabbb0782ffe None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:49.009779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f092d-079a-40c3-8ed4-aabbb0782ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:49.057900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2c0f092d-079a-40c3-8ed4-aabbb0782ffe None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:49.060351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c0f092d-079a-40c3-8ed4-aabbb0782ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:49.170621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9edf45959843a8b20b58e57f34c03c', 'request_id': 'req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:49.176889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:49.187730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9edf45959843a8b20b58e57f34c03c', 'request_id': 'req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:49.209092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9edf45959843a8b20b58e57f34c03c', 'request_id': 'req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:49.226087 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:49.236421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] The token cache is being invalidate because project 1a9edf45959843a8b20b58e57f34c03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:34:49.236841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:49.261724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:49.270105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 831/1651] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:34:48 2022] DELETE /identity/v3/projects/1a9edf45959843a8b20b58e57f34c03c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:49.270962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 821/1652] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:34:49.272218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ad0d-c7db-47de-913b-4b03c4ded36e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:49.272513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ad0d-c7db-47de-913b-4b03c4ded36e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:49.272781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ad0d-c7db-47de-913b-4b03c4ded36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:49.273890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:49.278366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:49.321870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a6d8ad0d-c7db-47de-913b-4b03c4ded36e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:49.323176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6d8ad0d-c7db-47de-913b-4b03c4ded36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:49.469991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5d57b-ba92-4a02-ad08-7e3363f98f90 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:49.483546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:49.485324 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:49.486043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:49.488039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] PATH_INFO: `/v3/users/e9393dcab2a541c8a4468cc7e8ff7cd7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:49.490370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9393dcab2a541c8a4468cc7e8ff7cd7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:49.490495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 822/1653] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:49.497251 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8ad0d-c7db-47de-913b-4b03c4ded36e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:49.497916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:49.499409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6d8ad0d-c7db-47de-913b-4b03c4ded36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:49.630968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9393dcab2a541c8a4468cc7e8ff7cd7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:49.632159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9393dcab2a541c8a4468cc7e8ff7cd7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:49.634508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8ad0d-c7db-47de-913b-4b03c4ded36e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:49.640909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23591dd8-8e19-448e-a566-73d809b3b1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:49.641902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23591dd8-8e19-448e-a566-73d809b3b1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:49.642348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23591dd8-8e19-448e-a566-73d809b3b1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:49.642861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23591dd8-8e19-448e-a566-73d809b3b1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:49.654275 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9393dcab2a541c8a4468cc7e8ff7cd7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:49.655523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23591dd8-8e19-448e-a566-73d809b3b1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:49.657277 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23591dd8-8e19-448e-a566-73d809b3b1b8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:49.671555 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 823/1654] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:49.673537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07737ce-8479-4f21-8969-b3ce564e3b62 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:49.673711 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9393dcab2a541c8a4468cc7e8ff7cd7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:49.674149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07737ce-8479-4f21-8969-b3ce564e3b62 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:49.674964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07737ce-8479-4f21-8969-b3ce564e3b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:49.680081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14bd3f80-4ebb-4551-a4da-fb5a573c6b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9393dcab2a541c8a4468cc7e8ff7cd7'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:49.707293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a07737ce-8479-4f21-8969-b3ce564e3b62 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:49.707485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 832/1655] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:34:49 2022] DELETE /identity/v3/users/e9393dcab2a541c8a4468cc7e8ff7cd7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:49.709047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a07737ce-8479-4f21-8969-b3ce564e3b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:49.712337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68f2a5-ef23-46c3-a3c8-b2daa2f68bd8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:49.712627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68f2a5-ef23-46c3-a3c8-b2daa2f68bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:49.713055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68f2a5-ef23-46c3-a3c8-b2daa2f68bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:49.757343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3a68f2a5-ef23-46c3-a3c8-b2daa2f68bd8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:49.759038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3a68f2a5-ef23-46c3-a3c8-b2daa2f68bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:49.843315 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 824/1656] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:49.850074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07737ce-8479-4f21-8969-b3ce564e3b62 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:49.862643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:49.867608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07737ce-8479-4f21-8969-b3ce564e3b62 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:49.875102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b7542-d606-418f-a341-915527a1d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:49.876235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7542-d606-418f-a341-915527a1d325 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:49.876877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7542-d606-418f-a341-915527a1d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:49.877354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7542-d606-418f-a341-915527a1d325 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:49.878377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b7542-d606-418f-a341-915527a1d325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:49.879026 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b7542-d606-418f-a341-915527a1d325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:49.881389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b7542-d606-418f-a341-915527a1d325 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:49.882488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 833/1657] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:34:49.900516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 825/1658] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:49.906777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68f2a5-ef23-46c3-a3c8-b2daa2f68bd8 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:49.910052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b7542-d606-418f-a341-915527a1d325 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:49.914973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-016b7542-d606-418f-a341-915527a1d325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:49.921376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68f2a5-ef23-46c3-a3c8-b2daa2f68bd8 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:49.940087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a03606-2979-4e30-b28c-b533ddcb2645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:49.940778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a03606-2979-4e30-b28c-b533ddcb2645 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:49.941134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a03606-2979-4e30-b28c-b533ddcb2645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:49.942216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a03606-2979-4e30-b28c-b533ddcb2645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:49.942216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a03606-2979-4e30-b28c-b533ddcb2645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:49.944020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a03606-2979-4e30-b28c-b533ddcb2645 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:49.993286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:50.004301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 834/1659] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:49 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:50.007993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a03606-2979-4e30-b28c-b533ddcb2645 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.033650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b7542-d606-418f-a341-915527a1d325 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.122599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a8463-a145-430d-a4f1-8c0791ebf510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.124186 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a8463-a145-430d-a4f1-8c0791ebf510 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.125723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a8463-a145-430d-a4f1-8c0791ebf510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.126924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a8463-a145-430d-a4f1-8c0791ebf510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.144286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a03606-2979-4e30-b28c-b533ddcb2645 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.153023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365270-e0ca-4f5b-8e97-87e3f3961866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.154158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365270-e0ca-4f5b-8e97-87e3f3961866 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.154552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365270-e0ca-4f5b-8e97-87e3f3961866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.154960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365270-e0ca-4f5b-8e97-87e3f3961866 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.156837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8365270-e0ca-4f5b-8e97-87e3f3961866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.157768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a8463-a145-430d-a4f1-8c0791ebf510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.161172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8365270-e0ca-4f5b-8e97-87e3f3961866 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.162010 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a8463-a145-430d-a4f1-8c0791ebf510 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.196715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 826/1660] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:50.202564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 835/1661] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:50 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:50.206703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a8463-a145-430d-a4f1-8c0791ebf510 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.231869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a8463-a145-430d-a4f1-8c0791ebf510 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.241800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e574cac-4673-42d7-a538-b4710c1285db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.242604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574cac-4673-42d7-a538-b4710c1285db admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.242923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574cac-4673-42d7-a538-b4710c1285db admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.243199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574cac-4673-42d7-a538-b4710c1285db admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.244719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e574cac-4673-42d7-a538-b4710c1285db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.254232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e574cac-4673-42d7-a538-b4710c1285db admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.268154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 827/1662] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:50.272004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365270-e0ca-4f5b-8e97-87e3f3961866 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.293523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365270-e0ca-4f5b-8e97-87e3f3961866 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.309049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c51e6-ef86-4fe8-9439-f4f55c210f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.312921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c51e6-ef86-4fe8-9439-f4f55c210f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.313282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c51e6-ef86-4fe8-9439-f4f55c210f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.313567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c51e6-ef86-4fe8-9439-f4f55c210f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.315948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c51e6-ef86-4fe8-9439-f4f55c210f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.321907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c51e6-ef86-4fe8-9439-f4f55c210f82 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.367384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 836/1663] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:50.371789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e574cac-4673-42d7-a538-b4710c1285db admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.388737 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e574cac-4673-42d7-a538-b4710c1285db admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.404090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da6bc4-90d2-4cd4-be12-b5e43b51305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.406769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da6bc4-90d2-4cd4-be12-b5e43b51305b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.407045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da6bc4-90d2-4cd4-be12-b5e43b51305b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.408887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da6bc4-90d2-4cd4-be12-b5e43b51305b admin admin] PATH_INFO: `/v3/projects/26ad9e2eb6824a2092603f5b6a7242b2/users/8f1d6aa1314940d08c41be02ae28ab56/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.460037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da6bc4-90d2-4cd4-be12-b5e43b51305b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ad9e2eb6824a2092603f5b6a7242b2, user_id=8f1d6aa1314940d08c41be02ae28ab56, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.464017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da6bc4-90d2-4cd4-be12-b5e43b51305b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.501066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 828/1664] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:50 2022] PUT /identity/v3/projects/26ad9e2eb6824a2092603f5b6a7242b2/users/8f1d6aa1314940d08c41be02ae28ab56/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:50.511693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1419846-da71-4aa1-bdaf-9794acad7fb1 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.512004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1419846-da71-4aa1-bdaf-9794acad7fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.512322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1419846-da71-4aa1-bdaf-9794acad7fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.601220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b872e1-6966-49d0-a17f-21a8258d135c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.601511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b872e1-6966-49d0-a17f-21a8258d135c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.601784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b872e1-6966-49d0-a17f-21a8258d135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.602769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e1419846-da71-4aa1-bdaf-9794acad7fb1 None None] MFA Rules not processed for user `8f1d6aa1314940d08c41be02ae28ab56`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:50.604197 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e1419846-da71-4aa1-bdaf-9794acad7fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:50.680506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a1b872e1-6966-49d0-a17f-21a8258d135c None None] MFA Rules not processed for user `0f98295f825e4d0c8fc54cf9cc07bae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:50.685029 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a1b872e1-6966-49d0-a17f-21a8258d135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:50.781763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 837/1665] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:50.786433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1419846-da71-4aa1-bdaf-9794acad7fb1 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.828882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 829/1666] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:50.844469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b872e1-6966-49d0-a17f-21a8258d135c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.846133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a1b872e1-6966-49d0-a17f-21a8258d135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:50.945185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:50.960340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:50.986982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1419846-da71-4aa1-bdaf-9794acad7fb1 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.003017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f8dee-36c2-4c50-b5df-af67daf95174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.004258 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f8dee-36c2-4c50-b5df-af67daf95174 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.004539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f8dee-36c2-4c50-b5df-af67daf95174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.005128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f8dee-36c2-4c50-b5df-af67daf95174 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.005451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f8dee-36c2-4c50-b5df-af67daf95174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.007415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f8dee-36c2-4c50-b5df-af67daf95174 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.031207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b872e1-6966-49d0-a17f-21a8258d135c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.046758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c51e8a-9fa0-4f31-9470-20289031eaa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.049876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c51e8a-9fa0-4f31-9470-20289031eaa0 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.050168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c51e8a-9fa0-4f31-9470-20289031eaa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.050460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c51e8a-9fa0-4f31-9470-20289031eaa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.076603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c51e8a-9fa0-4f31-9470-20289031eaa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.083145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c51e8a-9fa0-4f31-9470-20289031eaa0 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.111798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 830/1667] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:51.125596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 838/1668] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:50 2022] POST /identity/v3/projects => generated 377 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:51.128639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c51e8a-9fa0-4f31-9470-20289031eaa0 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.153980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c51e8a-9fa0-4f31-9470-20289031eaa0 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.376854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b18802-a129-4dfd-8988-1585e1c6e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.377557 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b18802-a129-4dfd-8988-1585e1c6e8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.377846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b18802-a129-4dfd-8988-1585e1c6e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.378122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b18802-a129-4dfd-8988-1585e1c6e8ef admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.378918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b18802-a129-4dfd-8988-1585e1c6e8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.384963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b18802-a129-4dfd-8988-1585e1c6e8ef admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.490093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f8dee-36c2-4c50-b5df-af67daf95174 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.492802 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-630f8dee-36c2-4c50-b5df-af67daf95174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:51.495245 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 831/1669] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:51 2022] POST /identity/v3/users => generated 295 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:51.499929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b18802-a129-4dfd-8988-1585e1c6e8ef admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.516532 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b18802-a129-4dfd-8988-1585e1c6e8ef admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.521294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f8dee-36c2-4c50-b5df-af67daf95174 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.524457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f874cfc-0dd9-406d-990f-747f3fdbfd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.527283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f874cfc-0dd9-406d-990f-747f3fdbfd00 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.527883 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f874cfc-0dd9-406d-990f-747f3fdbfd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.528385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f874cfc-0dd9-406d-990f-747f3fdbfd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.529281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f874cfc-0dd9-406d-990f-747f3fdbfd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.536821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.537429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.537708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.537980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] PATH_INFO: `/v3/projects/f3b203e32fe74e9b97e28c1daaf1941c` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.540454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f874cfc-0dd9-406d-990f-747f3fdbfd00 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.543035 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b203e32fe74e9b97e28c1daaf1941c)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.545637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.568477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 832/1670] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:51.572261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f874cfc-0dd9-406d-990f-747f3fdbfd00 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.590121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f874cfc-0dd9-406d-990f-747f3fdbfd00 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.596086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9cc7b-775b-43fb-af18-cd851f2026c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.606415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9cc7b-775b-43fb-af18-cd851f2026c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.608202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9cc7b-775b-43fb-af18-cd851f2026c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.608682 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9cc7b-775b-43fb-af18-cd851f2026c6 admin admin] PATH_INFO: `/v3/projects/e955bfc84fa24c36bec15b910c9ca255/users/8ab914528327408ab42db9807ead4cdf/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.629972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b203e32fe74e9b97e28c1daaf1941c', 'request_id': 'req-574c70f0-cc30-4fc3-a20d-a72c4983cd51'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:51.635970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9cc7b-775b-43fb-af18-cd851f2026c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e955bfc84fa24c36bec15b910c9ca255, user_id=8ab914528327408ab42db9807ead4cdf, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.640673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b203e32fe74e9b97e28c1daaf1941c', 'request_id': 'req-574c70f0-cc30-4fc3-a20d-a72c4983cd51'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:51.641207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9cc7b-775b-43fb-af18-cd851f2026c6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.691830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b203e32fe74e9b97e28c1daaf1941c', 'request_id': 'req-574c70f0-cc30-4fc3-a20d-a72c4983cd51'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:51.708092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 833/1671] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:51 2022] PUT /identity/v3/projects/e955bfc84fa24c36bec15b910c9ca255/users/8ab914528327408ab42db9807ead4cdf/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:51.712131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9cc7b-775b-43fb-af18-cd851f2026c6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.743606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] The token cache is being invalidate because project f3b203e32fe74e9b97e28c1daaf1941c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:34:51.746003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:51.747242 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-574c70f0-cc30-4fc3-a20d-a72c4983cd51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:51.750467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 839/1672] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:34:51 2022] DELETE /identity/v3/projects/f3b203e32fe74e9b97e28c1daaf1941c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:34:51.756122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074292d-977a-4f3a-b8a9-8f46e06b6503 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.756463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074292d-977a-4f3a-b8a9-8f46e06b6503 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.756734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074292d-977a-4f3a-b8a9-8f46e06b6503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.837602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5074292d-977a-4f3a-b8a9-8f46e06b6503 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:51.843194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5074292d-977a-4f3a-b8a9-8f46e06b6503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:51.944842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9cc7b-775b-43fb-af18-cd851f2026c6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.960915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6e7be-b7ca-4f0a-bca1-db8c20edb4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.961546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6e7be-b7ca-4f0a-bca1-db8c20edb4cb admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.961946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6e7be-b7ca-4f0a-bca1-db8c20edb4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.962112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6e7be-b7ca-4f0a-bca1-db8c20edb4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.962777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6e7be-b7ca-4f0a-bca1-db8c20edb4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.967449 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6e7be-b7ca-4f0a-bca1-db8c20edb4cb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:52.004848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 834/1673] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:52.009003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6e7be-b7ca-4f0a-bca1-db8c20edb4cb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.013346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4df6e7be-b7ca-4f0a-bca1-db8c20edb4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:52.042987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 840/1674] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:52.043907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074292d-977a-4f3a-b8a9-8f46e06b6503 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.048252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6e7be-b7ca-4f0a-bca1-db8c20edb4cb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:52.049765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5074292d-977a-4f3a-b8a9-8f46e06b6503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:52.068611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:52.069238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.069520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.069790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] PATH_INFO: `/v3/projects/bfe7b6d3ff8c473b9dc21037ee8e4248` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.071257 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe7b6d3ff8c473b9dc21037ee8e4248)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:52.076303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074292d-977a-4f3a-b8a9-8f46e06b6503 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:52.078250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:52.094934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29e07c-757a-4cda-bbcf-71ece34faf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:52.094934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29e07c-757a-4cda-bbcf-71ece34faf70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.095195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29e07c-757a-4cda-bbcf-71ece34faf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.095487 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29e07c-757a-4cda-bbcf-71ece34faf70 admin admin] PATH_INFO: `/v3/projects/e955bfc84fa24c36bec15b910c9ca255/users/8ab914528327408ab42db9807ead4cdf/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.099344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29e07c-757a-4cda-bbcf-71ece34faf70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e955bfc84fa24c36bec15b910c9ca255, user_id=8ab914528327408ab42db9807ead4cdf, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:52.107554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29e07c-757a-4cda-bbcf-71ece34faf70 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:52.134542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:52.146491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 841/1675] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:52 2022] PUT /identity/v3/projects/e955bfc84fa24c36bec15b910c9ca255/users/8ab914528327408ab42db9807ead4cdf/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:52.148489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67020706-f35b-4dc2-a031-7608e9dc4e7b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.148780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67020706-f35b-4dc2-a031-7608e9dc4e7b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.154375 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67020706-f35b-4dc2-a031-7608e9dc4e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.205392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-67020706-f35b-4dc2-a031-7608e9dc4e7b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:52.206645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-67020706-f35b-4dc2-a031-7608e9dc4e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:52.222521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe7b6d3ff8c473b9dc21037ee8e4248', 'request_id': 'req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:52.235038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe7b6d3ff8c473b9dc21037ee8e4248', 'request_id': 'req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:52.260181 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe7b6d3ff8c473b9dc21037ee8e4248', 'request_id': 'req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:52.297113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:52.299885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] The token cache is being invalidate because project bfe7b6d3ff8c473b9dc21037ee8e4248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:34:52.300180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:52.303759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cb8aa972-4497-462e-bfa7-a0a7e6819cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:52.313756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 835/1676] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:34:52 2022] DELETE /identity/v3/projects/bfe7b6d3ff8c473b9dc21037ee8e4248 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:52.315226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcf358-098f-498c-9bd4-a88d192ba6e2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.322904 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcf358-098f-498c-9bd4-a88d192ba6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.323284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcf358-098f-498c-9bd4-a88d192ba6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.360949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 842/1677] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:52.362072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67020706-f35b-4dc2-a031-7608e9dc4e7b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.363594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-67020706-f35b-4dc2-a031-7608e9dc4e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:52.384807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b6fcf358-098f-498c-9bd4-a88d192ba6e2 None None] MFA Rules not processed for user `8ab914528327408ab42db9807ead4cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:52.389075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b6fcf358-098f-498c-9bd4-a88d192ba6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:52.392718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67020706-f35b-4dc2-a031-7608e9dc4e7b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:52.404900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:52.406311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.406805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.407166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] PATH_INFO: `/v3/users/3643459bb30140bb9432a0d71af0cb16` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.408593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3643459bb30140bb9432a0d71af0cb16)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:52.414505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:52.521541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3643459bb30140bb9432a0d71af0cb16'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:52.523742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3643459bb30140bb9432a0d71af0cb16'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:52.561892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3643459bb30140bb9432a0d71af0cb16'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:52.579433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3643459bb30140bb9432a0d71af0cb16'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:52.582862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef9b06d0-625e-4f78-beed-7b14c72ccd56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3643459bb30140bb9432a0d71af0cb16'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:52.599210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 836/1678] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:52.600332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcf358-098f-498c-9bd4-a88d192ba6e2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.618266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 843/1679] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:34:52 2022] DELETE /identity/v3/users/3643459bb30140bb9432a0d71af0cb16 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:52.624201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764ba35-bb7b-48aa-a397-e42731c4a3b4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.624468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764ba35-bb7b-48aa-a397-e42731c4a3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.624750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764ba35-bb7b-48aa-a397-e42731c4a3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.635059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcf358-098f-498c-9bd4-a88d192ba6e2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:52.687746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7764ba35-bb7b-48aa-a397-e42731c4a3b4 None None] MFA Rules not processed for user `f961b156bc31426abf95e303115be233`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:52.697242 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7764ba35-bb7b-48aa-a397-e42731c4a3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:52.853656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310961de-2614-449e-b174-9a8953f48251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:52.855238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310961de-2614-449e-b174-9a8953f48251 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.855826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310961de-2614-449e-b174-9a8953f48251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.856259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310961de-2614-449e-b174-9a8953f48251 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.856957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310961de-2614-449e-b174-9a8953f48251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:52.857263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310961de-2614-449e-b174-9a8953f48251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:52.875051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310961de-2614-449e-b174-9a8953f48251 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:52.920585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 837/1680] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:52.931446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310961de-2614-449e-b174-9a8953f48251 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.933898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 844/1681] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:52.935055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-310961de-2614-449e-b174-9a8953f48251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:52.936996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764ba35-bb7b-48aa-a397-e42731c4a3b4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.943737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7764ba35-bb7b-48aa-a397-e42731c4a3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:52.996916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764ba35-bb7b-48aa-a397-e42731c4a3b4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.019024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994499f-7b8e-4d8b-93fd-340b221706d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.019207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:53.020453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994499f-7b8e-4d8b-93fd-340b221706d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.020904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994499f-7b8e-4d8b-93fd-340b221706d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.021754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994499f-7b8e-4d8b-93fd-340b221706d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.040343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994499f-7b8e-4d8b-93fd-340b221706d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.042874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994499f-7b8e-4d8b-93fd-340b221706d6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.141310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310961de-2614-449e-b174-9a8953f48251 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.150502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8865870-a5db-41be-bb30-8dc63eeb6188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.151522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8865870-a5db-41be-bb30-8dc63eeb6188 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.155140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 845/1682] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:52 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:53.156797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8865870-a5db-41be-bb30-8dc63eeb6188 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.157207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8865870-a5db-41be-bb30-8dc63eeb6188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.157625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567be63-2c77-4b2c-9f1b-af1e7214afd9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.158033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567be63-2c77-4b2c-9f1b-af1e7214afd9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.159044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567be63-2c77-4b2c-9f1b-af1e7214afd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.169070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f8865870-a5db-41be-bb30-8dc63eeb6188 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:53.221992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6567be63-2c77-4b2c-9f1b-af1e7214afd9 None None] MFA Rules not processed for user `f961b156bc31426abf95e303115be233`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:53.223250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6567be63-2c77-4b2c-9f1b-af1e7214afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:53.278964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:53.362908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8865870-a5db-41be-bb30-8dc63eeb6188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.365100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8865870-a5db-41be-bb30-8dc63eeb6188 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.400444 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 838/1683] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:53.402220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8865870-a5db-41be-bb30-8dc63eeb6188 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:53.410013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 846/1684] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:53.424398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567be63-2c77-4b2c-9f1b-af1e7214afd9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:53.426222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6567be63-2c77-4b2c-9f1b-af1e7214afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:53.434488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8865870-a5db-41be-bb30-8dc63eeb6188 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.635421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9c5bd-2bbf-4ac1-ad3e-5ef393598d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.636760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9c5bd-2bbf-4ac1-ad3e-5ef393598d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.637040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9c5bd-2bbf-4ac1-ad3e-5ef393598d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.637317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9c5bd-2bbf-4ac1-ad3e-5ef393598d41 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.640692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9c5bd-2bbf-4ac1-ad3e-5ef393598d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.643051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9c5bd-2bbf-4ac1-ad3e-5ef393598d41 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.728210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 839/1685] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:53 2022] POST /identity/v3/users => generated 288 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:53.729088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9c5bd-2bbf-4ac1-ad3e-5ef393598d41 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:53.736684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-12b9c5bd-2bbf-4ac1-ad3e-5ef393598d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:53.770049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9c5bd-2bbf-4ac1-ad3e-5ef393598d41 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.781962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567be63-2c77-4b2c-9f1b-af1e7214afd9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.791593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.796472 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.796984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.797727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] PATH_INFO: `/v3/users/9000009a061e4a12b37d591d72adc2a1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.805361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9000009a061e4a12b37d591d72adc2a1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.807431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80a78-5ab6-4b00-b4a8-fed724f66282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.809158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80a78-5ab6-4b00-b4a8-fed724f66282 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.812366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.816350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80a78-5ab6-4b00-b4a8-fed724f66282 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.818255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80a78-5ab6-4b00-b4a8-fed724f66282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.840349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e80a78-5ab6-4b00-b4a8-fed724f66282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.845615 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e80a78-5ab6-4b00-b4a8-fed724f66282 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.873268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 847/1686] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:34:53.874497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80a78-5ab6-4b00-b4a8-fed724f66282 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:53.901912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80a78-5ab6-4b00-b4a8-fed724f66282 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.909669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b70e5-b7c5-4ae6-9e64-6a79b7a1ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.910746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b70e5-b7c5-4ae6-9e64-6a79b7a1ffc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.911342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b70e5-b7c5-4ae6-9e64-6a79b7a1ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.911906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b70e5-b7c5-4ae6-9e64-6a79b7a1ffc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.918491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b70e5-b7c5-4ae6-9e64-6a79b7a1ffc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.923849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b70e5-b7c5-4ae6-9e64-6a79b7a1ffc1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.957214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 848/1687] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:53.958740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b70e5-b7c5-4ae6-9e64-6a79b7a1ffc1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:53.971739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b70e5-b7c5-4ae6-9e64-6a79b7a1ffc1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.977349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740acc1-9953-4c2e-9433-408d7ac2c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.977955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740acc1-9953-4c2e-9433-408d7ac2c661 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.978364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740acc1-9953-4c2e-9433-408d7ac2c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.979156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740acc1-9953-4c2e-9433-408d7ac2c661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.980204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740acc1-9953-4c2e-9433-408d7ac2c661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.981756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9000009a061e4a12b37d591d72adc2a1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:53.982243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740acc1-9953-4c2e-9433-408d7ac2c661 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.982690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9000009a061e4a12b37d591d72adc2a1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:54.009237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9000009a061e4a12b37d591d72adc2a1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:54.010412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9000009a061e4a12b37d591d72adc2a1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:54.019555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 849/1688] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:54.021879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740acc1-9953-4c2e-9433-408d7ac2c661 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:54.029743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:54.032094 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1740acc1-9953-4c2e-9433-408d7ac2c661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:54.066888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-529004c1-7a88-4a7d-b482-42b283288d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9000009a061e4a12b37d591d72adc2a1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:54.098027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740acc1-9953-4c2e-9433-408d7ac2c661 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:54.116421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 840/1689] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:34:53 2022] DELETE /identity/v3/users/9000009a061e4a12b37d591d72adc2a1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:54.126994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cea4c2-c1d5-40a6-b69a-b5eae7053c5b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:54.128301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cea4c2-c1d5-40a6-b69a-b5eae7053c5b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:54.131361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cea4c2-c1d5-40a6-b69a-b5eae7053c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:54.233670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e1cea4c2-c1d5-40a6-b69a-b5eae7053c5b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:54.236537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e1cea4c2-c1d5-40a6-b69a-b5eae7053c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:54.339120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca11149-c141-41a4-8f86-1ebf69d19936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:54.339120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca11149-c141-41a4-8f86-1ebf69d19936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:54.339781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca11149-c141-41a4-8f86-1ebf69d19936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:54.345674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca11149-c141-41a4-8f86-1ebf69d19936 admin admin] PATH_INFO: `/v3/projects/613954364b184317a748336ee0278625/users/394a028d61254d338ed93e0aa4d6c8a9/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:54.385592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 841/1690] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:54.417082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca11149-c141-41a4-8f86-1ebf69d19936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613954364b184317a748336ee0278625, user_id=394a028d61254d338ed93e0aa4d6c8a9, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:54.424799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca11149-c141-41a4-8f86-1ebf69d19936 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:54.463017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 850/1691] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:54 2022] PUT /identity/v3/projects/613954364b184317a748336ee0278625/users/394a028d61254d338ed93e0aa4d6c8a9/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:54.482835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6617f5-fd01-46e4-bd11-1fc723473464 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:54.483551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6617f5-fd01-46e4-bd11-1fc723473464 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:54.483766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6617f5-fd01-46e4-bd11-1fc723473464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:54.506498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca11149-c141-41a4-8f86-1ebf69d19936 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:54.508331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dca11149-c141-41a4-8f86-1ebf69d19936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:54.542928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:54.567150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6d6617f5-fd01-46e4-bd11-1fc723473464 None None] MFA Rules not processed for user `394a028d61254d338ed93e0aa4d6c8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:54.571446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6d6617f5-fd01-46e4-bd11-1fc723473464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:54.687889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca11149-c141-41a4-8f86-1ebf69d19936 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:54.712500 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dae8c4-98c3-471f-8ad3-5ae12dc18f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:54.713722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dae8c4-98c3-471f-8ad3-5ae12dc18f4c service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:54.715278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dae8c4-98c3-471f-8ad3-5ae12dc18f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:54.716443 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dae8c4-98c3-471f-8ad3-5ae12dc18f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:54.779371 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 842/1692] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:54.786604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6617f5-fd01-46e4-bd11-1fc723473464 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:54.788269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6d6617f5-fd01-46e4-bd11-1fc723473464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:54.935199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dae8c4-98c3-471f-8ad3-5ae12dc18f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:54.939739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dae8c4-98c3-471f-8ad3-5ae12dc18f4c service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:54.954879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6617f5-fd01-46e4-bd11-1fc723473464 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:54.970638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c9fa8-be71-41a5-b427-bdd5511c7028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:54.971322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c9fa8-be71-41a5-b427-bdd5511c7028 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:54.971877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c9fa8-be71-41a5-b427-bdd5511c7028 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:54.972118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c9fa8-be71-41a5-b427-bdd5511c7028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:54.984719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:54.987825 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 851/1693] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:54.997110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c9fa8-be71-41a5-b427-bdd5511c7028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:55.002529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c9fa8-be71-41a5-b427-bdd5511c7028 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:55.029931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 843/1694] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:55.211401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dae8c4-98c3-471f-8ad3-5ae12dc18f4c service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:55.213188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c5dae8c4-98c3-471f-8ad3-5ae12dc18f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:55.244553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dae8c4-98c3-471f-8ad3-5ae12dc18f4c service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:55.289905 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:55.290501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:55.290983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:55.291481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] PATH_INFO: `/v3/projects/03193a8044e84f47999ecdc389cfda18` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:55.298295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03193a8044e84f47999ecdc389cfda18)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:55.300326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:55.566077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c9fa8-be71-41a5-b427-bdd5511c7028 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:55.576428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03193a8044e84f47999ecdc389cfda18', 'request_id': 'req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:55.582389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c9fa8-be71-41a5-b427-bdd5511c7028 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:55.590808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03193a8044e84f47999ecdc389cfda18', 'request_id': 'req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:55.616305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03193a8044e84f47999ecdc389cfda18', 'request_id': 'req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:55.661024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] The token cache is being invalidate because project 03193a8044e84f47999ecdc389cfda18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:34:55.661328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:55.662715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9f9999bb-7cc2-467b-a4b6-0f22c6710b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:55.669242 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 852/1695] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:34:55 2022] DELETE /identity/v3/projects/03193a8044e84f47999ecdc389cfda18 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:55.671110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3d71d-5d71-49b4-b8ab-c384df5bef77 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:55.671526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3d71d-5d71-49b4-b8ab-c384df5bef77 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:55.671809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3d71d-5d71-49b4-b8ab-c384df5bef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:55.735446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-acf3d71d-5d71-49b4-b8ab-c384df5bef77 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:55.746304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-acf3d71d-5d71-49b4-b8ab-c384df5bef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:55.753769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:55.754430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:55.754953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:55.755238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] PATH_INFO: `/v3/users/394a028d61254d338ed93e0aa4d6c8a9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:55.757434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=394a028d61254d338ed93e0aa4d6c8a9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:55.765598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:55.787747 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 853/1696] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:34:55.799395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548f081-edf8-4c55-8055-6008832d60d3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:55.799731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548f081-edf8-4c55-8055-6008832d60d3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:55.799960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548f081-edf8-4c55-8055-6008832d60d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:55.882024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8548f081-edf8-4c55-8055-6008832d60d3 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:55.885986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8548f081-edf8-4c55-8055-6008832d60d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:55.894561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394a028d61254d338ed93e0aa4d6c8a9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:55.895840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394a028d61254d338ed93e0aa4d6c8a9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:55.922256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 854/1697] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:34:55.927850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394a028d61254d338ed93e0aa4d6c8a9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:55.928567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394a028d61254d338ed93e0aa4d6c8a9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:55.931761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548f081-edf8-4c55-8055-6008832d60d3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:55.952770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548f081-edf8-4c55-8055-6008832d60d3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:55.957956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1fb33ea8-8357-4aff-bfb8-a0be109e8c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394a028d61254d338ed93e0aa4d6c8a9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:55.968578 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf6a12-1a66-40b4-87e6-0b518ae02ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:55.970192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf6a12-1a66-40b4-87e6-0b518ae02ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:55.970649 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf6a12-1a66-40b4-87e6-0b518ae02ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:55.971131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf6a12-1a66-40b4-87e6-0b518ae02ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:55.972004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf6a12-1a66-40b4-87e6-0b518ae02ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:55.973083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf6a12-1a66-40b4-87e6-0b518ae02ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:55.976169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf6a12-1a66-40b4-87e6-0b518ae02ccd admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:55.994749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 844/1698] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:34:55 2022] DELETE /identity/v3/users/394a028d61254d338ed93e0aa4d6c8a9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:56.001854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897a5e-2f05-45a4-8b4c-91969f0d2503 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.001854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897a5e-2f05-45a4-8b4c-91969f0d2503 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.001854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897a5e-2f05-45a4-8b4c-91969f0d2503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.013186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 855/1699] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:56.017468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf6a12-1a66-40b4-87e6-0b518ae02ccd admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:56.022810 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-46bf6a12-1a66-40b4-87e6-0b518ae02ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:56.055608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0d897a5e-2f05-45a4-8b4c-91969f0d2503 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:56.061235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0d897a5e-2f05-45a4-8b4c-91969f0d2503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:56.061853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf6a12-1a66-40b4-87e6-0b518ae02ccd admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:56.107989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:56.241153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d366156-f669-4306-a60f-dd3709586655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:56.241956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d366156-f669-4306-a60f-dd3709586655 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.242114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d366156-f669-4306-a60f-dd3709586655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.242387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d366156-f669-4306-a60f-dd3709586655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.246715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d366156-f669-4306-a60f-dd3709586655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:56.250517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d366156-f669-4306-a60f-dd3709586655 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:56.258176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 845/1700] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:34:56.258176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fc0d-95bf-4287-abd3-a090dd5bd140 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.258176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fc0d-95bf-4287-abd3-a090dd5bd140 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.258176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fc0d-95bf-4287-abd3-a090dd5bd140 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.260095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 846/1701] 10.222.0.23 () {54 vars in 912 bytes} [Tue Oct 4 08:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:56.265799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fae4e-f52d-435b-a3d4-7e9399caeead None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.266080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fae4e-f52d-435b-a3d4-7e9399caeead None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.266358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fae4e-f52d-435b-a3d4-7e9399caeead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.344756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 856/1702] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:56 2022] POST /identity/v3/projects => generated 379 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:56.345410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d366156-f669-4306-a60f-dd3709586655 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:56.346826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:56.353642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7d366156-f669-4306-a60f-dd3709586655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:56.382108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-844fae4e-f52d-435b-a3d4-7e9399caeead None None] MFA Rules not processed for user `9a186bffa7854d34b91edfa4eb4b2498`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:56.383388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-844fae4e-f52d-435b-a3d4-7e9399caeead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:56.505594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 847/1703] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:34:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:34:56.506471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fae4e-f52d-435b-a3d4-7e9399caeead None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:56.516205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d366156-f669-4306-a60f-dd3709586655 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:56.529979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3fcca-6c39-45bf-b8df-df5e8161929d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:56.531702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3fcca-6c39-45bf-b8df-df5e8161929d service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.532081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3fcca-6c39-45bf-b8df-df5e8161929d service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.532251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3fcca-6c39-45bf-b8df-df5e8161929d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.680242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fae4e-f52d-435b-a3d4-7e9399caeead None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:56.694641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9e517-7835-46d8-b8d2-4b2b3b36bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:56.695370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9e517-7835-46d8-b8d2-4b2b3b36bf41 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.695733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9e517-7835-46d8-b8d2-4b2b3b36bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.696002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9e517-7835-46d8-b8d2-4b2b3b36bf41 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.696684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9e517-7835-46d8-b8d2-4b2b3b36bf41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:56.701542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9e517-7835-46d8-b8d2-4b2b3b36bf41 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:56.752315 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 848/1704] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:56 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:56.753319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9e517-7835-46d8-b8d2-4b2b3b36bf41 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:56.757250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-34b9e517-7835-46d8-b8d2-4b2b3b36bf41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:56.762344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3fcca-6c39-45bf-b8df-df5e8161929d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:56.768129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3fcca-6c39-45bf-b8df-df5e8161929d service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:56.791139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9e517-7835-46d8-b8d2-4b2b3b36bf41 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:56.804575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdee39e-b0fb-41a7-a18e-d192715fcfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:56.806004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdee39e-b0fb-41a7-a18e-d192715fcfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.806448 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdee39e-b0fb-41a7-a18e-d192715fcfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.806806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdee39e-b0fb-41a7-a18e-d192715fcfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.822495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 857/1705] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:56.823429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3fcca-6c39-45bf-b8df-df5e8161929d service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:56.830629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9bb3fcca-6c39-45bf-b8df-df5e8161929d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:56.832913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdee39e-b0fb-41a7-a18e-d192715fcfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:56.834392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdee39e-b0fb-41a7-a18e-d192715fcfe3 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:56.873395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 849/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:56.874384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdee39e-b0fb-41a7-a18e-d192715fcfe3 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:56.875204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3fcca-6c39-45bf-b8df-df5e8161929d service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:56.881026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:56.881679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.881960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.883160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] PATH_INFO: `/v3/projects/637a13e73f5a4127a6b4b44d255e3473` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.887534 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] RBAC: Authorizing `identity:delete_project(project_id=637a13e73f5a4127a6b4b44d255e3473)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:56.889486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:56.901735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdee39e-b0fb-41a7-a18e-d192715fcfe3 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:56.919528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeeeca-5c20-4072-9ddd-b61da41d38fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:56.920386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeeeca-5c20-4072-9ddd-b61da41d38fc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.920671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeeeca-5c20-4072-9ddd-b61da41d38fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.920947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeeeca-5c20-4072-9ddd-b61da41d38fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.921711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeeeca-5c20-4072-9ddd-b61da41d38fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:56.933124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeeeca-5c20-4072-9ddd-b61da41d38fc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:56.978725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 850/1707] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:56.979770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeeeca-5c20-4072-9ddd-b61da41d38fc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:56.987176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-85aeeeca-5c20-4072-9ddd-b61da41d38fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:57.051568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:57.054593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637a13e73f5a4127a6b4b44d255e3473', 'request_id': 'req-67d8cd08-dd5a-4065-ba81-11553e38679d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:57.075149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637a13e73f5a4127a6b4b44d255e3473', 'request_id': 'req-67d8cd08-dd5a-4065-ba81-11553e38679d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:57.091200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637a13e73f5a4127a6b4b44d255e3473', 'request_id': 'req-67d8cd08-dd5a-4065-ba81-11553e38679d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:57.121229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] The token cache is being invalidate because project 637a13e73f5a4127a6b4b44d255e3473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:34:57.121698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:57.122537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:57.124415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 858/1708] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:34:56 2022] DELETE /identity/v3/projects/637a13e73f5a4127a6b4b44d255e3473 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:57.125236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:57.126866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:57.140618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeeeca-5c20-4072-9ddd-b61da41d38fc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:57.204758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:57.244803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a208cd-29b0-44cf-9a99-33d9d518bcdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:57.246529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a208cd-29b0-44cf-9a99-33d9d518bcdf service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.247014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a208cd-29b0-44cf-9a99-33d9d518bcdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.247479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a208cd-29b0-44cf-9a99-33d9d518bcdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.249591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b7a208cd-29b0-44cf-9a99-33d9d518bcdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:57.398433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a208cd-29b0-44cf-9a99-33d9d518bcdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:57.400041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a208cd-29b0-44cf-9a99-33d9d518bcdf service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:57.434006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8cd08-dd5a-4065-ba81-11553e38679d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:57.447422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 851/1709] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:57.456479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f408325-7ca4-4d61-8db7-0b75d9b89d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:57.456714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f408325-7ca4-4d61-8db7-0b75d9b89d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.457077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f408325-7ca4-4d61-8db7-0b75d9b89d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.457495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f408325-7ca4-4d61-8db7-0b75d9b89d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.458539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f408325-7ca4-4d61-8db7-0b75d9b89d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:57.463374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4ac82-98ac-441a-9dbf-86f3bbe3e73f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.471329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f408325-7ca4-4d61-8db7-0b75d9b89d33 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:57.473854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4ac82-98ac-441a-9dbf-86f3bbe3e73f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.485048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4ac82-98ac-441a-9dbf-86f3bbe3e73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.520210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 859/1710] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:57.526016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a648d-85dc-461d-8874-410d562f4a4d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.537041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a648d-85dc-461d-8874-410d562f4a4d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.537225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a648d-85dc-461d-8874-410d562f4a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.603340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-60c4ac82-98ac-441a-9dbf-86f3bbe3e73f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:57.606263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-60c4ac82-98ac-441a-9dbf-86f3bbe3e73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:57.627938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 852/1711] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:57.629468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4ac82-98ac-441a-9dbf-86f3bbe3e73f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:57.652268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a00a648d-85dc-461d-8874-410d562f4a4d None None] MFA Rules not processed for user `89745e9f5689415ab763980f222fe682`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:57.654569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a00a648d-85dc-461d-8874-410d562f4a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:57.657723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4ac82-98ac-441a-9dbf-86f3bbe3e73f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:57.670405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a23ce-d47b-4521-8fa7-73146c1f3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:57.672425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a23ce-d47b-4521-8fa7-73146c1f3f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.672719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a23ce-d47b-4521-8fa7-73146c1f3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.673997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a23ce-d47b-4521-8fa7-73146c1f3f87 admin admin] PATH_INFO: `/v3/projects/0d1f0fecdbba44ba898ebe8cad0cc4cd/users/6c52d5c0daa049e79b4da92ae9f06b1a/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.756252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a23ce-d47b-4521-8fa7-73146c1f3f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1f0fecdbba44ba898ebe8cad0cc4cd, user_id=6c52d5c0daa049e79b4da92ae9f06b1a, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:57.767142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a23ce-d47b-4521-8fa7-73146c1f3f87 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:57.817835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 853/1712] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:57 2022] PUT /identity/v3/projects/0d1f0fecdbba44ba898ebe8cad0cc4cd/users/6c52d5c0daa049e79b4da92ae9f06b1a/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:57.817835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d3c98-07e3-440f-9d70-9a5aa0848311 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.817835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d3c98-07e3-440f-9d70-9a5aa0848311 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.817835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d3c98-07e3-440f-9d70-9a5aa0848311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.868908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ed4d3c98-07e3-440f-9d70-9a5aa0848311 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:57.872680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ed4d3c98-07e3-440f-9d70-9a5aa0848311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:57.894547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 860/1713] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:57.900564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff558642-5437-4618-a4d2-c40d2f2bdf69 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.903778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff558642-5437-4618-a4d2-c40d2f2bdf69 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.904447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff558642-5437-4618-a4d2-c40d2f2bdf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.977414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ff558642-5437-4618-a4d2-c40d2f2bdf69 None None] MFA Rules not processed for user `6c52d5c0daa049e79b4da92ae9f06b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:57.978847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ff558642-5437-4618-a4d2-c40d2f2bdf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:58.029515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 854/1714] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:58.029515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922b70-6a1a-4c20-8049-2706025aba65 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:58.029515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922b70-6a1a-4c20-8049-2706025aba65 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:58.029515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922b70-6a1a-4c20-8049-2706025aba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:58.131312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a1922b70-6a1a-4c20-8049-2706025aba65 None None] MFA Rules not processed for user `89745e9f5689415ab763980f222fe682`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:58.135932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a1922b70-6a1a-4c20-8049-2706025aba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:58.168940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:58.212344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 861/1715] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:58.213581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff558642-5437-4618-a4d2-c40d2f2bdf69 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:58.257173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff558642-5437-4618-a4d2-c40d2f2bdf69 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:58.276912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f26cc-e4ff-4355-9de1-c0efb1473258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:58.282452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f26cc-e4ff-4355-9de1-c0efb1473258 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:58.282855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f26cc-e4ff-4355-9de1-c0efb1473258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:58.283135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f26cc-e4ff-4355-9de1-c0efb1473258 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:58.288815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f26cc-e4ff-4355-9de1-c0efb1473258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:58.289177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f26cc-e4ff-4355-9de1-c0efb1473258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:58.292376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f26cc-e4ff-4355-9de1-c0efb1473258 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:58.333919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 862/1716] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:58.335539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f26cc-e4ff-4355-9de1-c0efb1473258 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:58.345888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-117f26cc-e4ff-4355-9de1-c0efb1473258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:58.349932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:58.408392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 855/1717] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:58.410808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1922b70-6a1a-4c20-8049-2706025aba65 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:58.456694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1922b70-6a1a-4c20-8049-2706025aba65 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:58.478507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb3917-240f-43b1-8f34-04bf07d4ef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:58.480323 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3917-240f-43b1-8f34-04bf07d4ef75 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:58.486896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3917-240f-43b1-8f34-04bf07d4ef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:58.487473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3917-240f-43b1-8f34-04bf07d4ef75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:58.488522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb3917-240f-43b1-8f34-04bf07d4ef75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:58.496908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb3917-240f-43b1-8f34-04bf07d4ef75 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:58.589004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 856/1718] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:58 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:58.597053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb3917-240f-43b1-8f34-04bf07d4ef75 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:58.629830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f26cc-e4ff-4355-9de1-c0efb1473258 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:58.779610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba6bd2-fe95-45c6-aac5-53d6618e0ad5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4030325cf0481ab634e253cfed9c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:58.780240 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba6bd2-fe95-45c6-aac5-53d6618e0ad5 service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:58.780523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba6bd2-fe95-45c6-aac5-53d6618e0ad5 service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:58.780796 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba6bd2-fe95-45c6-aac5-53d6618e0ad5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:58.788444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bcba6bd2-fe95-45c6-aac5-53d6618e0ad5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:58.811964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba6bd2-fe95-45c6-aac5-53d6618e0ad5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:58.813478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba6bd2-fe95-45c6-aac5-53d6618e0ad5 service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:58.816653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb3917-240f-43b1-8f34-04bf07d4ef75 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:58.830699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263251d2-61d6-4782-84f9-e067c12c8e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:58.831623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263251d2-61d6-4782-84f9-e067c12c8e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:58.831995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263251d2-61d6-4782-84f9-e067c12c8e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:58.832381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263251d2-61d6-4782-84f9-e067c12c8e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:58.833099 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263251d2-61d6-4782-84f9-e067c12c8e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:58.838235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263251d2-61d6-4782-84f9-e067c12c8e10 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:58.839530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 863/1719] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:58.840297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba6bd2-fe95-45c6-aac5-53d6618e0ad5 service placement] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:58.850446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bcba6bd2-fe95-45c6-aac5-53d6618e0ad5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:58.901918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 857/1720] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:34:58 2022] POST /identity/v3/projects => generated 369 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:58.907558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a842c-3bf5-44ef-92d1-71043580e22c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:58.907805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a842c-3bf5-44ef-92d1-71043580e22c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:58.909579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a842c-3bf5-44ef-92d1-71043580e22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:58.971979 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7a3a842c-3bf5-44ef-92d1-71043580e22c None None] MFA Rules not processed for user `f961b156bc31426abf95e303115be233`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:58.977861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7a3a842c-3bf5-44ef-92d1-71043580e22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:59.091526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba6bd2-fe95-45c6-aac5-53d6618e0ad5 service placement] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:59.109365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:59.151545 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 858/1721] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:59.152395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a842c-3bf5-44ef-92d1-71043580e22c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:59.206412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a7c02-0619-4ac5-b4cc-60275084ad80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:59.207069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a7c02-0619-4ac5-b4cc-60275084ad80 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.207486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a7c02-0619-4ac5-b4cc-60275084ad80 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.207766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a7c02-0619-4ac5-b4cc-60275084ad80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.310567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a842c-3bf5-44ef-92d1-71043580e22c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:59.319109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377153d6-368a-4516-a46e-07be616508e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:59.319841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377153d6-368a-4516-a46e-07be616508e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.320244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377153d6-368a-4516-a46e-07be616508e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.320579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377153d6-368a-4516-a46e-07be616508e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.321437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377153d6-368a-4516-a46e-07be616508e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:59.324742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377153d6-368a-4516-a46e-07be616508e9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:59.338038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:59.349793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a7c02-0619-4ac5-b4cc-60275084ad80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:59.351436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a7c02-0619-4ac5-b4cc-60275084ad80 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:59.361630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 859/1722] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:59 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:59.363242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a7289-6560-4103-8f7b-291e175c6755 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.363534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a7289-6560-4103-8f7b-291e175c6755 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.364494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a7289-6560-4103-8f7b-291e175c6755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.372813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 864/1723] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:34:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:34:59.373710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a7c02-0619-4ac5-b4cc-60275084ad80 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:59.375515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-405a7c02-0619-4ac5-b4cc-60275084ad80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:59.404935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a7c02-0619-4ac5-b4cc-60275084ad80 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:59.408516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-036a7289-6560-4103-8f7b-291e175c6755 None None] MFA Rules not processed for user `0f98295f825e4d0c8fc54cf9cc07bae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:59.409874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-036a7289-6560-4103-8f7b-291e175c6755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:59.423217 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:59.423975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.424259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.424538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] PATH_INFO: `/v3/projects/613954364b184317a748336ee0278625` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.428832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=613954364b184317a748336ee0278625)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:59.430983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:59.515387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 860/1724] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:59.517087 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a7289-6560-4103-8f7b-291e175c6755 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:59.542122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a7289-6560-4103-8f7b-291e175c6755 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:59.574405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613954364b184317a748336ee0278625', 'request_id': 'req-b4ebf76c-d5e6-4895-86b8-f83a025748a5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:59.585753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613954364b184317a748336ee0278625', 'request_id': 'req-b4ebf76c-d5e6-4895-86b8-f83a025748a5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:59.602627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613954364b184317a748336ee0278625', 'request_id': 'req-b4ebf76c-d5e6-4895-86b8-f83a025748a5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:59.638294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] The token cache is being invalidate because project 613954364b184317a748336ee0278625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:34:59.638591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:59.639643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4ebf76c-d5e6-4895-86b8-f83a025748a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:34:59.642110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 865/1725] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:34:59 2022] DELETE /identity/v3/projects/613954364b184317a748336ee0278625 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:59.646251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615122d-3641-401b-96a5-ca6263b8e1e0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.646611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615122d-3641-401b-96a5-ca6263b8e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.646841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615122d-3641-401b-96a5-ca6263b8e1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.674619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532921-e3c8-4eb0-ae20-9c74181ed7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:59.675307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532921-e3c8-4eb0-ae20-9c74181ed7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.675597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532921-e3c8-4eb0-ae20-9c74181ed7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.676282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532921-e3c8-4eb0-ae20-9c74181ed7ca admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.677331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09532921-e3c8-4eb0-ae20-9c74181ed7ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:59.679279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09532921-e3c8-4eb0-ae20-9c74181ed7ca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:59.730154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 861/1726] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:59 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:59.731217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532921-e3c8-4eb0-ae20-9c74181ed7ca admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:59.734833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-09532921-e3c8-4eb0-ae20-9c74181ed7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:59.739689 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2615122d-3641-401b-96a5-ca6263b8e1e0 None None] MFA Rules not processed for user `96219eb4a7d649848ee4e700ae7a65f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:59.746751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2615122d-3641-401b-96a5-ca6263b8e1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:59.768955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532921-e3c8-4eb0-ae20-9c74181ed7ca admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:59.781558 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:59.782365 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e3df0-be31-472e-bae1-10a4ee5367c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:59.782785 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3df0-be31-472e-bae1-10a4ee5367c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.783070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3df0-be31-472e-bae1-10a4ee5367c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.783340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3df0-be31-472e-bae1-10a4ee5367c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.783997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e3df0-be31-472e-bae1-10a4ee5367c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:59.785862 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e3df0-be31-472e-bae1-10a4ee5367c1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:59.818729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 862/1727] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:59.827153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b62d1-f184-441a-ac1f-e81186a4646f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.827714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b62d1-f184-441a-ac1f-e81186a4646f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.828136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b62d1-f184-441a-ac1f-e81186a4646f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.876170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-473b62d1-f184-441a-ac1f-e81186a4646f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:59.878418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-473b62d1-f184-441a-ac1f-e81186a4646f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:59.905348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 863/1728] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:59.905348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b62d1-f184-441a-ac1f-e81186a4646f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:59.905629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 866/1729] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:34:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:34:59.906637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615122d-3641-401b-96a5-ca6263b8e1e0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:59.921141 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-473b62d1-f184-441a-ac1f-e81186a4646f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:59.942136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615122d-3641-401b-96a5-ca6263b8e1e0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:59.951525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3439284-c7b3-4c84-bf7c-a639022a9fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:59.952224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3439284-c7b3-4c84-bf7c-a639022a9fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.952750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3439284-c7b3-4c84-bf7c-a639022a9fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.953028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3439284-c7b3-4c84-bf7c-a639022a9fc1 admin admin] PATH_INFO: `/v3/projects/0e72b44c099d493798552e14356f5a25/users/0b3ea3ceda8e44b48039c3e206e0028b/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.953826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b62d1-f184-441a-ac1f-e81186a4646f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:59.969203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10286d5-88cd-4ee7-aa5e-4059c402a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:59.970111 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10286d5-88cd-4ee7-aa5e-4059c402a734 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.970585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10286d5-88cd-4ee7-aa5e-4059c402a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.972615 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10286d5-88cd-4ee7-aa5e-4059c402a734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.973914 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10286d5-88cd-4ee7-aa5e-4059c402a734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:59.976819 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10286d5-88cd-4ee7-aa5e-4059c402a734 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:59.993214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3439284-c7b3-4c84-bf7c-a639022a9fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e72b44c099d493798552e14356f5a25, user_id=0b3ea3ceda8e44b48039c3e206e0028b, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:59.997664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3439284-c7b3-4c84-bf7c-a639022a9fc1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.009831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 864/1730] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:00.018601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80a62-d4d0-467c-ae6c-3ad76a910f83 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.018944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80a62-d4d0-467c-ae6c-3ad76a910f83 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.019227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80a62-d4d0-467c-ae6c-3ad76a910f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.041539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 867/1731] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:34:59 2022] PUT /identity/v3/projects/0e72b44c099d493798552e14356f5a25/users/0b3ea3ceda8e44b48039c3e206e0028b/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:00.047005 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3439284-c7b3-4c84-bf7c-a639022a9fc1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.063705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-09b80a62-d4d0-467c-ae6c-3ad76a910f83 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:00.064999 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-09b80a62-d4d0-467c-ae6c-3ad76a910f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:00.193805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:00.214146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 865/1732] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:00.218247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b80a62-d4d0-467c-ae6c-3ad76a910f83 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.241390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3439284-c7b3-4c84-bf7c-a639022a9fc1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.248424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b80a62-d4d0-467c-ae6c-3ad76a910f83 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.263613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e4a3-1fe2-4137-ac4d-5f9d119a83ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.264798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e4a3-1fe2-4137-ac4d-5f9d119a83ed admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.265349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e4a3-1fe2-4137-ac4d-5f9d119a83ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.265949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e4a3-1fe2-4137-ac4d-5f9d119a83ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.268236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e4a3-1fe2-4137-ac4d-5f9d119a83ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.269675 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9b1bf-fbdb-48c1-9c85-5186b54f2761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.271465 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b1bf-fbdb-48c1-9c85-5186b54f2761 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.272731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b1bf-fbdb-48c1-9c85-5186b54f2761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.273025 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b1bf-fbdb-48c1-9c85-5186b54f2761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.273535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e4a3-1fe2-4137-ac4d-5f9d119a83ed admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.273688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9b1bf-fbdb-48c1-9c85-5186b54f2761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.280500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9b1bf-fbdb-48c1-9c85-5186b54f2761 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.314068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 868/1733] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:00.316835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd81c3e-8565-4376-afcf-22412cdadf8b None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.317669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd81c3e-8565-4376-afcf-22412cdadf8b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.318804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 866/1734] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:00.322326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9b1bf-fbdb-48c1-9c85-5186b54f2761 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.322773 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd81c3e-8565-4376-afcf-22412cdadf8b None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.328569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 869/1735] 10.222.0.23 () {54 vars in 912 bytes} [Tue Oct 4 08:35:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:00.331730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd81c3e-8565-4376-afcf-22412cdadf8b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.347161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9b1bf-fbdb-48c1-9c85-5186b54f2761 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.359690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc39cf-aa5f-4975-a0ae-b45e46e7fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.360489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc39cf-aa5f-4975-a0ae-b45e46e7fb1d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.363242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc39cf-aa5f-4975-a0ae-b45e46e7fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.364978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc39cf-aa5f-4975-a0ae-b45e46e7fb1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.365873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc39cf-aa5f-4975-a0ae-b45e46e7fb1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:00.368176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc39cf-aa5f-4975-a0ae-b45e46e7fb1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.372224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc39cf-aa5f-4975-a0ae-b45e46e7fb1d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.376965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd81c3e-8565-4376-afcf-22412cdadf8b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.384095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade31f1-39c6-4cf7-af80-15791b85f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.384995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade31f1-39c6-4cf7-af80-15791b85f7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.385858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade31f1-39c6-4cf7-af80-15791b85f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.386197 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade31f1-39c6-4cf7-af80-15791b85f7b7 admin admin] PATH_INFO: `/v3/projects/f9c6e33455e548de89301105a7f4e3cd/users/4c0cdd1e3d484941acb6f94b8a602407/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.411432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 867/1736] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:00.413160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc39cf-aa5f-4975-a0ae-b45e46e7fb1d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.429070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc39cf-aa5f-4975-a0ae-b45e46e7fb1d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.447249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511c46f-2a5f-48c5-a846-d4f2e826470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.448125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511c46f-2a5f-48c5-a846-d4f2e826470b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.448885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511c46f-2a5f-48c5-a846-d4f2e826470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.448885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511c46f-2a5f-48c5-a846-d4f2e826470b admin admin] PATH_INFO: `/v3/projects/0e72b44c099d493798552e14356f5a25/users/0b3ea3ceda8e44b48039c3e206e0028b/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.449855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade31f1-39c6-4cf7-af80-15791b85f7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c6e33455e548de89301105a7f4e3cd, user_id=4c0cdd1e3d484941acb6f94b8a602407, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.453683 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511c46f-2a5f-48c5-a846-d4f2e826470b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e72b44c099d493798552e14356f5a25, user_id=0b3ea3ceda8e44b48039c3e206e0028b, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.456642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511c46f-2a5f-48c5-a846-d4f2e826470b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.460468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade31f1-39c6-4cf7-af80-15791b85f7b7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.489086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 868/1737] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:00 2022] PUT /identity/v3/projects/0e72b44c099d493798552e14356f5a25/users/0b3ea3ceda8e44b48039c3e206e0028b/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:00.490868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c7dc1-973c-4ce7-8e2f-151c67b8563c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.491333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c7dc1-973c-4ce7-8e2f-151c67b8563c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.491781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c7dc1-973c-4ce7-8e2f-151c67b8563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.505486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 870/1738] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:00 2022] PUT /identity/v3/projects/f9c6e33455e548de89301105a7f4e3cd/users/4c0cdd1e3d484941acb6f94b8a602407/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:00.517110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade31f1-39c6-4cf7-af80-15791b85f7b7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.551283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a07c7dc1-973c-4ce7-8e2f-151c67b8563c None None] MFA Rules not processed for user `9a186bffa7854d34b91edfa4eb4b2498`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:00.554442 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a07c7dc1-973c-4ce7-8e2f-151c67b8563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:00.691298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 869/1739] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:35:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:00.694102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d73d55-445d-454e-985f-374c3aa24d92 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.694102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d73d55-445d-454e-985f-374c3aa24d92 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.694395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d73d55-445d-454e-985f-374c3aa24d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.700992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade31f1-39c6-4cf7-af80-15791b85f7b7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.719154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e10eec-9834-406c-a480-793c36ac06ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.721334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e10eec-9834-406c-a480-793c36ac06ea admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.721614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e10eec-9834-406c-a480-793c36ac06ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.721893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e10eec-9834-406c-a480-793c36ac06ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.723984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e10eec-9834-406c-a480-793c36ac06ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.725962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e10eec-9834-406c-a480-793c36ac06ea admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.773188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:00.784678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b7d73d55-445d-454e-985f-374c3aa24d92 None None] MFA Rules not processed for user `0b3ea3ceda8e44b48039c3e206e0028b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:00.785903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b7d73d55-445d-454e-985f-374c3aa24d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:00.818227 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 871/1740] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:00 2022] POST /identity/v3/projects => generated 381 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:00.819645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95091e5c-14c4-4a0c-8f75-0941906a55b2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.819899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95091e5c-14c4-4a0c-8f75-0941906a55b2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.820176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95091e5c-14c4-4a0c-8f75-0941906a55b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.879576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-95091e5c-14c4-4a0c-8f75-0941906a55b2 None None] MFA Rules not processed for user `4c0cdd1e3d484941acb6f94b8a602407`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:00.885787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-95091e5c-14c4-4a0c-8f75-0941906a55b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:00.999794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 872/1741] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:01.000812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95091e5c-14c4-4a0c-8f75-0941906a55b2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:01.011605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-95091e5c-14c4-4a0c-8f75-0941906a55b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:01.029605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 870/1742] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:01.030793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d73d55-445d-454e-985f-374c3aa24d92 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:01.052751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d73d55-445d-454e-985f-374c3aa24d92 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:01.170720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95091e5c-14c4-4a0c-8f75-0941906a55b2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:01.175223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccbc42-3744-4b46-b4ad-982791e74f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:01.176038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccbc42-3744-4b46-b4ad-982791e74f63 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:01.176477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccbc42-3744-4b46-b4ad-982791e74f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:01.176946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccbc42-3744-4b46-b4ad-982791e74f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:01.203113 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccbc42-3744-4b46-b4ad-982791e74f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:01.204909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccbc42-3744-4b46-b4ad-982791e74f63 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:01.216352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:01.235497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99387d-25d8-4319-be7d-a418e6d4e015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:01.236392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99387d-25d8-4319-be7d-a418e6d4e015 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:01.236665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99387d-25d8-4319-be7d-a418e6d4e015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:01.236945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99387d-25d8-4319-be7d-a418e6d4e015 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:01.237601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99387d-25d8-4319-be7d-a418e6d4e015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:01.243170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99387d-25d8-4319-be7d-a418e6d4e015 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:01.250579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 873/1743] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:01.251760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccbc42-3744-4b46-b4ad-982791e74f63 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:01.278599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccbc42-3744-4b46-b4ad-982791e74f63 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:01.291716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130955a-4b5f-4022-82d0-6f35eff9df80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:01.292495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130955a-4b5f-4022-82d0-6f35eff9df80 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:01.292862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130955a-4b5f-4022-82d0-6f35eff9df80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:01.293198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130955a-4b5f-4022-82d0-6f35eff9df80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:01.293912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130955a-4b5f-4022-82d0-6f35eff9df80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:01.298283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130955a-4b5f-4022-82d0-6f35eff9df80 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:01.348224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 871/1744] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:01 2022] POST /identity/v3/users => generated 291 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:01.353489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99387d-25d8-4319-be7d-a418e6d4e015 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:01.357827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dd99387d-25d8-4319-be7d-a418e6d4e015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:01.404929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 874/1745] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:01 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:01.404929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130955a-4b5f-4022-82d0-6f35eff9df80 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:01.523678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99387d-25d8-4319-be7d-a418e6d4e015 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:01.634159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130955a-4b5f-4022-82d0-6f35eff9df80 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:01.641718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d041fbd-0a23-47e1-aea7-b0e03f79d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:01.642835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d041fbd-0a23-47e1-aea7-b0e03f79d3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:01.643336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d041fbd-0a23-47e1-aea7-b0e03f79d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:01.643818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d041fbd-0a23-47e1-aea7-b0e03f79d3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:01.644877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d041fbd-0a23-47e1-aea7-b0e03f79d3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:01.647038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d041fbd-0a23-47e1-aea7-b0e03f79d3c7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:01.650277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:01.701556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 875/1746] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:01.702941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d041fbd-0a23-47e1-aea7-b0e03f79d3c7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:01.726016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d041fbd-0a23-47e1-aea7-b0e03f79d3c7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:01.734423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584faeb-3669-4650-b8eb-0fb220af836a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:01.736902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584faeb-3669-4650-b8eb-0fb220af836a service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:01.737197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584faeb-3669-4650-b8eb-0fb220af836a service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:01.737480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584faeb-3669-4650-b8eb-0fb220af836a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:01.745990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc458b46-776c-44a5-980a-f3b6ce10934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:01.750136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc458b46-776c-44a5-980a-f3b6ce10934e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:01.751111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc458b46-776c-44a5-980a-f3b6ce10934e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:01.751649 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc458b46-776c-44a5-980a-f3b6ce10934e admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:01.752845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc458b46-776c-44a5-980a-f3b6ce10934e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:01.757714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc458b46-776c-44a5-980a-f3b6ce10934e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:01.848739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 876/1747] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:01 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:01.856805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc458b46-776c-44a5-980a-f3b6ce10934e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:01.881537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc458b46-776c-44a5-980a-f3b6ce10934e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:01.889099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ca66-8661-4da7-b06b-6d9b7558a6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:01.890163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ca66-8661-4da7-b06b-6d9b7558a6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:01.890368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ca66-8661-4da7-b06b-6d9b7558a6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:01.890549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ca66-8661-4da7-b06b-6d9b7558a6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:01.891362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03ca66-8661-4da7-b06b-6d9b7558a6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:01.894447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03ca66-8661-4da7-b06b-6d9b7558a6ae admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:01.918658 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 877/1748] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:01.920261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ca66-8661-4da7-b06b-6d9b7558a6ae admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:01.960454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ca66-8661-4da7-b06b-6d9b7558a6ae admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:01.986308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73175e15-cf49-4558-b433-26b505c6f81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:01.986918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73175e15-cf49-4558-b433-26b505c6f81b admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:01.987195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73175e15-cf49-4558-b433-26b505c6f81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:01.987468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73175e15-cf49-4558-b433-26b505c6f81b admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:01.988123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73175e15-cf49-4558-b433-26b505c6f81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:01.991490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73175e15-cf49-4558-b433-26b505c6f81b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:02.023855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 878/1749] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:02.023855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73175e15-cf49-4558-b433-26b505c6f81b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:02.043598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584faeb-3669-4650-b8eb-0fb220af836a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:02.045741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584faeb-3669-4650-b8eb-0fb220af836a service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:02.055436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73175e15-cf49-4558-b433-26b505c6f81b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:02.062708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 872/1750] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:02.076875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cf9b6-7fe0-4499-9c8d-f1232ef47cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:02.078387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf9b6-7fe0-4499-9c8d-f1232ef47cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:02.080470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf9b6-7fe0-4499-9c8d-f1232ef47cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:02.080873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf9b6-7fe0-4499-9c8d-f1232ef47cdb admin admin] PATH_INFO: `/v3/projects/a355b5786ce84c8c8621dbdbe9b1a514/users/163c5f907b894341b89734ed67fbcd19/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:02.081799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584faeb-3669-4650-b8eb-0fb220af836a service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:02.119356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584faeb-3669-4650-b8eb-0fb220af836a service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:02.131669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cf9b6-7fe0-4499-9c8d-f1232ef47cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a355b5786ce84c8c8621dbdbe9b1a514, user_id=163c5f907b894341b89734ed67fbcd19, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:02.134525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cf9b6-7fe0-4499-9c8d-f1232ef47cdb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:02.145873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061a0fd-8194-464b-b753-be5d147cfda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:02.147823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061a0fd-8194-464b-b753-be5d147cfda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:02.150926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061a0fd-8194-464b-b753-be5d147cfda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:02.152298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061a0fd-8194-464b-b753-be5d147cfda5 admin admin] PATH_INFO: `/v3/projects/e7f9b5fd0ab042aa91db659e83c58fbb/users/8e2b84a5574a41b795001d0ddd86cfe4/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:02.157815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 879/1751] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:02 2022] PUT /identity/v3/projects/a355b5786ce84c8c8621dbdbe9b1a514/users/163c5f907b894341b89734ed67fbcd19/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:02.175279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b67d6-8c16-4376-bf86-ed4e4b1bc919 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:02.175279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b67d6-8c16-4376-bf86-ed4e4b1bc919 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:02.175279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b67d6-8c16-4376-bf86-ed4e4b1bc919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:02.209982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061a0fd-8194-464b-b753-be5d147cfda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f9b5fd0ab042aa91db659e83c58fbb, user_id=8e2b84a5574a41b795001d0ddd86cfe4, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:02.213902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061a0fd-8194-464b-b753-be5d147cfda5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:02.216385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-211b67d6-8c16-4376-bf86-ed4e4b1bc919 None None] MFA Rules not processed for user `163c5f907b894341b89734ed67fbcd19`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:02.217859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-211b67d6-8c16-4376-bf86-ed4e4b1bc919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:02.263541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 873/1752] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:02 2022] PUT /identity/v3/projects/e7f9b5fd0ab042aa91db659e83c58fbb/users/8e2b84a5574a41b795001d0ddd86cfe4/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:02.268758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061a0fd-8194-464b-b753-be5d147cfda5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:02.393147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:02.460289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 880/1753] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:02.461340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b67d6-8c16-4376-bf86-ed4e4b1bc919 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:02.467196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-211b67d6-8c16-4376-bf86-ed4e4b1bc919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:02.495905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061a0fd-8194-464b-b753-be5d147cfda5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:02.516067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ebf58-92e4-451a-906c-18a5c6e8cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:02.516719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ebf58-92e4-451a-906c-18a5c6e8cc31 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:02.517003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ebf58-92e4-451a-906c-18a5c6e8cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:02.517410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ebf58-92e4-451a-906c-18a5c6e8cc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:02.517920 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ebf58-92e4-451a-906c-18a5c6e8cc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:02.519713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ebf58-92e4-451a-906c-18a5c6e8cc31 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:02.548809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 874/1754] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:02.551046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ebf58-92e4-451a-906c-18a5c6e8cc31 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:02.599349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ebf58-92e4-451a-906c-18a5c6e8cc31 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:02.620752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc79524-a600-4396-8430-048ba6012dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:02.621388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc79524-a600-4396-8430-048ba6012dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:02.621713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc79524-a600-4396-8430-048ba6012dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:02.621937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc79524-a600-4396-8430-048ba6012dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:02.622739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc79524-a600-4396-8430-048ba6012dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:02.642871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc79524-a600-4396-8430-048ba6012dfc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:02.722859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 875/1755] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:02 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:02.722859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc79524-a600-4396-8430-048ba6012dfc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:02.747862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b67d6-8c16-4376-bf86-ed4e4b1bc919 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:02.825057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:02.936303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc79524-a600-4396-8430-048ba6012dfc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:02.957459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dea45-4b32-4fd9-9b18-2baf173c7afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:02.960709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dea45-4b32-4fd9-9b18-2baf173c7afc admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:02.961756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dea45-4b32-4fd9-9b18-2baf173c7afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:02.962745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dea45-4b32-4fd9-9b18-2baf173c7afc admin admin] PATH_INFO: `/v3/projects/e7f9b5fd0ab042aa91db659e83c58fbb/users/8e2b84a5574a41b795001d0ddd86cfe4/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:02.968669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327830df-3bca-49fb-ad1f-d10508aa76a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:02.971583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dea45-4b32-4fd9-9b18-2baf173c7afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f9b5fd0ab042aa91db659e83c58fbb, user_id=8e2b84a5574a41b795001d0ddd86cfe4, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:02.973023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327830df-3bca-49fb-ad1f-d10508aa76a4 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:02.973264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327830df-3bca-49fb-ad1f-d10508aa76a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:02.973539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327830df-3bca-49fb-ad1f-d10508aa76a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:02.992663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dea45-4b32-4fd9-9b18-2baf173c7afc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:03.043104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 876/1756] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:02 2022] PUT /identity/v3/projects/e7f9b5fd0ab042aa91db659e83c58fbb/users/8e2b84a5574a41b795001d0ddd86cfe4/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:03.044678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71be7d-ae40-4ac5-ac81-504fd03395a3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.044975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71be7d-ae40-4ac5-ac81-504fd03395a3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.045253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71be7d-ae40-4ac5-ac81-504fd03395a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.171607 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327830df-3bca-49fb-ad1f-d10508aa76a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:03.177722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327830df-3bca-49fb-ad1f-d10508aa76a4 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:03.210730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2d71be7d-ae40-4ac5-ac81-504fd03395a3 None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:03.212747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2d71be7d-ae40-4ac5-ac81-504fd03395a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:03.222018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 881/1757] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 761 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:03.224894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327830df-3bca-49fb-ad1f-d10508aa76a4 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:03.265434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327830df-3bca-49fb-ad1f-d10508aa76a4 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:03.345109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 877/1758] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:35:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:03.349401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf001d14-4df1-48a4-aaca-166d8841d94b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.349940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf001d14-4df1-48a4-aaca-166d8841d94b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.350401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf001d14-4df1-48a4-aaca-166d8841d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.438046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:03.477669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bf001d14-4df1-48a4-aaca-166d8841d94b None None] MFA Rules not processed for user `8e2b84a5574a41b795001d0ddd86cfe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:03.485322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bf001d14-4df1-48a4-aaca-166d8841d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:03.534648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41c1d7-3507-4609-a505-3bf146c4548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:03.539539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41c1d7-3507-4609-a505-3bf146c4548e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.540874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41c1d7-3507-4609-a505-3bf146c4548e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.541397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41c1d7-3507-4609-a505-3bf146c4548e admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.545966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41c1d7-3507-4609-a505-3bf146c4548e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:03.553092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41c1d7-3507-4609-a505-3bf146c4548e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:03.630646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 882/1759] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:03 2022] POST /identity/v3/users => generated 297 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:03.631706 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41c1d7-3507-4609-a505-3bf146c4548e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:03.767260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 878/1760] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:03.770293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf001d14-4df1-48a4-aaca-166d8841d94b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:03.805951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf001d14-4df1-48a4-aaca-166d8841d94b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:03.826253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae27e0a-9913-4c07-a618-82447ad33cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:03.829946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae27e0a-9913-4c07-a618-82447ad33cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.830217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae27e0a-9913-4c07-a618-82447ad33cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.831487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae27e0a-9913-4c07-a618-82447ad33cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.832159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae27e0a-9913-4c07-a618-82447ad33cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:03.835712 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:03.842247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae27e0a-9913-4c07-a618-82447ad33cbe admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:03.879442 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 879/1761] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:03.881586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae27e0a-9913-4c07-a618-82447ad33cbe admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:03.883449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41c1d7-3507-4609-a505-3bf146c4548e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:03.888004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4ae27e0a-9913-4c07-a618-82447ad33cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:03.905873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09494f50-6740-4d31-9350-343be1fa4449 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3ea3ceda8e44b48039c3e206e0028b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e72b44c099d493798552e14356f5a25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:03.907158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09494f50-6740-4d31-9350-343be1fa4449 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.907534 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09494f50-6740-4d31-9350-343be1fa4449 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.907812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09494f50-6740-4d31-9350-343be1fa4449 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.908481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09494f50-6740-4d31-9350-343be1fa4449 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:03.913787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09494f50-6740-4d31-9350-343be1fa4449 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:03.917795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09494f50-6740-4d31-9350-343be1fa4449 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:03.941281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 883/1762] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:03.942167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09494f50-6740-4d31-9350-343be1fa4449 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:03.947024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-09494f50-6740-4d31-9350-343be1fa4449 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:04.091836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09494f50-6740-4d31-9350-343be1fa4449 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:04.100757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b5731-dac4-4cdd-b5c7-4d46cbb40010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:04.101426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b5731-dac4-4cdd-b5c7-4d46cbb40010 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:04.101655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b5731-dac4-4cdd-b5c7-4d46cbb40010 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:04.101927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b5731-dac4-4cdd-b5c7-4d46cbb40010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:04.111677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae27e0a-9913-4c07-a618-82447ad33cbe admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:04.125602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1eadd-0d8e-4dd0-854d-ce3c85944dd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:04.126466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1eadd-0d8e-4dd0-854d-ce3c85944dd5 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:04.126928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1eadd-0d8e-4dd0-854d-ce3c85944dd5 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:04.127348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1eadd-0d8e-4dd0-854d-ce3c85944dd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:04.129680 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b5731-dac4-4cdd-b5c7-4d46cbb40010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:04.133795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b5731-dac4-4cdd-b5c7-4d46cbb40010 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:04.157489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1eadd-0d8e-4dd0-854d-ce3c85944dd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:04.163389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 884/1763] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:04.164574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1eadd-0d8e-4dd0-854d-ce3c85944dd5 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:04.165328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b5731-dac4-4cdd-b5c7-4d46cbb40010 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:04.182342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 880/1764] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:35:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:35:04.183820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1eadd-0d8e-4dd0-854d-ce3c85944dd5 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:04.227824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b5731-dac4-4cdd-b5c7-4d46cbb40010 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:04.245748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3751-0932-4fd9-bcd5-4ed2f2720d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:04.248448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3751-0932-4fd9-bcd5-4ed2f2720d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:04.248738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3751-0932-4fd9-bcd5-4ed2f2720d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:04.249019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3751-0932-4fd9-bcd5-4ed2f2720d43 admin admin] PATH_INFO: `/v3/projects/3d9d6d5ec96f48f3bb3c4cf5372eae65/users/863892696d94404fa2e82ab3c0b038ed/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:04.256949 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1eadd-0d8e-4dd0-854d-ce3c85944dd5 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:04.276452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b8abf-19c2-460e-901e-d7b00ae6b4ec tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3ea3ceda8e44b48039c3e206e0028b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e72b44c099d493798552e14356f5a25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:04.277605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b8abf-19c2-460e-901e-d7b00ae6b4ec tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:04.278084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b8abf-19c2-460e-901e-d7b00ae6b4ec tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:04.278552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b8abf-19c2-460e-901e-d7b00ae6b4ec tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:04.283034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b8abf-19c2-460e-901e-d7b00ae6b4ec tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:04.285470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b8abf-19c2-460e-901e-d7b00ae6b4ec tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:04.345124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb3751-0932-4fd9-bcd5-4ed2f2720d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9d6d5ec96f48f3bb3c4cf5372eae65, user_id=863892696d94404fa2e82ab3c0b038ed, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:04.363878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb3751-0932-4fd9-bcd5-4ed2f2720d43 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:04.444811 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 885/1765] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:04 2022] PUT /identity/v3/projects/3d9d6d5ec96f48f3bb3c4cf5372eae65/users/863892696d94404fa2e82ab3c0b038ed/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:04.455479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3751-0932-4fd9-bcd5-4ed2f2720d43 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:04.485126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 881/1766] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:04 2022] POST /identity/v3/projects => generated 354 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:04.486572 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b8abf-19c2-460e-901e-d7b00ae6b4ec tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:04.702196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:04.854090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b8abf-19c2-460e-901e-d7b00ae6b4ec tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:04.884856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3751-0932-4fd9-bcd5-4ed2f2720d43 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:04.887707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8f209-320f-493b-b250-1cc1341c6706 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3ea3ceda8e44b48039c3e206e0028b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e72b44c099d493798552e14356f5a25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:04.888482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f209-320f-493b-b250-1cc1341c6706 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:04.888895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f209-320f-493b-b250-1cc1341c6706 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:04.889318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f209-320f-493b-b250-1cc1341c6706 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:04.890099 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f209-320f-493b-b250-1cc1341c6706 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:04.890483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f209-320f-493b-b250-1cc1341c6706 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:04.899712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f209-320f-493b-b250-1cc1341c6706 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:05.016450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 882/1767] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:05.020118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07694121-1252-4c34-8744-4d8308e03284 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:05.020118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07694121-1252-4c34-8744-4d8308e03284 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:05.036116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07694121-1252-4c34-8744-4d8308e03284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:05.069424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f34d3-99f3-4dc4-ab94-de4e958c71f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:05.070080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f34d3-99f3-4dc4-ab94-de4e958c71f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:05.070368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f34d3-99f3-4dc4-ab94-de4e958c71f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:05.073290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f34d3-99f3-4dc4-ab94-de4e958c71f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:05.074175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f34d3-99f3-4dc4-ab94-de4e958c71f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:05.078704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f34d3-99f3-4dc4-ab94-de4e958c71f7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:05.111006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 886/1768] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 658 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:05.117592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f34d3-99f3-4dc4-ab94-de4e958c71f7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:05.159809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:05.169679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f34d3-99f3-4dc4-ab94-de4e958c71f7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:05.170002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-07694121-1252-4c34-8744-4d8308e03284 None None] MFA Rules not processed for user `9a186bffa7854d34b91edfa4eb4b2498`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:05.176464 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07694121-1252-4c34-8744-4d8308e03284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:05.190326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce6b5e-f1db-4f87-90ba-5e26c97d6cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:05.191416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce6b5e-f1db-4f87-90ba-5e26c97d6cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:05.192986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce6b5e-f1db-4f87-90ba-5e26c97d6cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:05.194899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce6b5e-f1db-4f87-90ba-5e26c97d6cdd admin admin] PATH_INFO: `/v3/projects/3d9d6d5ec96f48f3bb3c4cf5372eae65/users/863892696d94404fa2e82ab3c0b038ed/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:05.208278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce6b5e-f1db-4f87-90ba-5e26c97d6cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9d6d5ec96f48f3bb3c4cf5372eae65, user_id=863892696d94404fa2e82ab3c0b038ed, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:05.228128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce6b5e-f1db-4f87-90ba-5e26c97d6cdd admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:05.268471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 887/1769] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:05 2022] PUT /identity/v3/projects/3d9d6d5ec96f48f3bb3c4cf5372eae65/users/863892696d94404fa2e82ab3c0b038ed/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:05.280873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629b3bb-226c-4de9-81c4-5100012229d0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:05.281806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629b3bb-226c-4de9-81c4-5100012229d0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:05.282252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629b3bb-226c-4de9-81c4-5100012229d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:05.405725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4629b3bb-226c-4de9-81c4-5100012229d0 None None] MFA Rules not processed for user `863892696d94404fa2e82ab3c0b038ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:05.411285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4629b3bb-226c-4de9-81c4-5100012229d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:05.441883 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 883/1770] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Oct 4 08:35:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:05.444083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07694121-1252-4c34-8744-4d8308e03284 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:05.492508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07694121-1252-4c34-8744-4d8308e03284 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:05.647953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 888/1771] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:05.648921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629b3bb-226c-4de9-81c4-5100012229d0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:05.650308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4629b3bb-226c-4de9-81c4-5100012229d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:05.676303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3ea3ceda8e44b48039c3e206e0028b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e72b44c099d493798552e14356f5a25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:05.678870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:05.679318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:05.680844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] PATH_INFO: `/v3/projects/a467087487114b3582613ee28172b7df` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:05.685692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a467087487114b3582613ee28172b7df)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:05.694142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:05.803615 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629b3bb-226c-4de9-81c4-5100012229d0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:05.810243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676098e-b478-441f-9409-0c9cc95ad4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:05.810902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676098e-b478-441f-9409-0c9cc95ad4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:05.811186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676098e-b478-441f-9409-0c9cc95ad4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:05.815124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676098e-b478-441f-9409-0c9cc95ad4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:05.858907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676098e-b478-441f-9409-0c9cc95ad4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:05.860230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a467087487114b3582613ee28172b7df', 'request_id': 'req-41936400-9fdc-4409-85d3-d44d6ea316c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:05.861370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676098e-b478-441f-9409-0c9cc95ad4e4 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:05.884833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a467087487114b3582613ee28172b7df', 'request_id': 'req-41936400-9fdc-4409-85d3-d44d6ea316c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:05.892952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 889/1772] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:05.896151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676098e-b478-441f-9409-0c9cc95ad4e4 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:05.913992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a467087487114b3582613ee28172b7df', 'request_id': 'req-41936400-9fdc-4409-85d3-d44d6ea316c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:05.947961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] The token cache is being invalidate because project a467087487114b3582613ee28172b7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:05.948430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:05.949235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:05.959766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 884/1773] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:05 2022] DELETE /identity/v3/projects/a467087487114b3582613ee28172b7df => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:06.016961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676098e-b478-441f-9409-0c9cc95ad4e4 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:06.101193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:06.142796 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc7382-b2b7-4649-87c1-505d2e9d20d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:06.143554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc7382-b2b7-4649-87c1-505d2e9d20d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:06.143838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc7382-b2b7-4649-87c1-505d2e9d20d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:06.144731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc7382-b2b7-4649-87c1-505d2e9d20d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:06.149255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d9dc7382-b2b7-4649-87c1-505d2e9d20d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:06.380564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc7382-b2b7-4649-87c1-505d2e9d20d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:06.384104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc7382-b2b7-4649-87c1-505d2e9d20d5 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:06.451066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 890/1774] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:06.853922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:06.855661 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:06.858764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc7382-b2b7-4649-87c1-505d2e9d20d5 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:06.860453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d9dc7382-b2b7-4649-87c1-505d2e9d20d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:06.864316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:06.882347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc7382-b2b7-4649-87c1-505d2e9d20d5 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:06.902657 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507b4ad-baba-40e4-89d6-be4d5918c373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:06.904253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b4ad-baba-40e4-89d6-be4d5918c373 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:06.905830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b4ad-baba-40e4-89d6-be4d5918c373 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:06.906319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b4ad-baba-40e4-89d6-be4d5918c373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:06.914551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1507b4ad-baba-40e4-89d6-be4d5918c373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:07.009812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41936400-9fdc-4409-85d3-d44d6ea316c1 tempest-VolumeQuotaClassesTest-14314930 tempest-VolumeQuotaClassesTest-14314930-project-admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:07.023519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:07.024171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:07.024451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:07.024730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] PATH_INFO: `/v3/users/6c52d5c0daa049e79b4da92ae9f06b1a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:07.027567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c52d5c0daa049e79b4da92ae9f06b1a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:07.029521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:07.117468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507b4ad-baba-40e4-89d6-be4d5918c373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:07.119928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507b4ad-baba-40e4-89d6-be4d5918c373 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:07.145206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 891/1775] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:07.152652 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c52d5c0daa049e79b4da92ae9f06b1a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:07.153522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c52d5c0daa049e79b4da92ae9f06b1a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:07.180537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c52d5c0daa049e79b4da92ae9f06b1a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:07.181369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c52d5c0daa049e79b4da92ae9f06b1a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:07.253706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c52d5c0daa049e79b4da92ae9f06b1a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:07.322229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 885/1776] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:06 2022] DELETE /identity/v3/users/6c52d5c0daa049e79b4da92ae9f06b1a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:07.323586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07525e8-28ab-4430-9f70-158d1ceadbeb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:07.324088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07525e8-28ab-4430-9f70-158d1ceadbeb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:07.324508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07525e8-28ab-4430-9f70-158d1ceadbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:07.423189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d07525e8-28ab-4430-9f70-158d1ceadbeb None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:07.429561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d07525e8-28ab-4430-9f70-158d1ceadbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:07.746471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 892/1777] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:07.813742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:07.815852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:08.020184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a007954-522f-47bb-a435-8be29623d896 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:08.029391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eddb27-6825-43ba-b163-3030618f6884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:08.030383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddb27-6825-43ba-b163-3030618f6884 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:08.031195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddb27-6825-43ba-b163-3030618f6884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:08.031845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddb27-6825-43ba-b163-3030618f6884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:08.079951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eddb27-6825-43ba-b163-3030618f6884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:08.083055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eddb27-6825-43ba-b163-3030618f6884 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:08.153620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 886/1778] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:10.493861 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07525e8-28ab-4430-9f70-158d1ceadbeb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:10.496710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d07525e8-28ab-4430-9f70-158d1ceadbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:10.525433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07525e8-28ab-4430-9f70-158d1ceadbeb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:10.543232 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:10.544258 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:10.544834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:10.545412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] PATH_INFO: `/v3/users/4c0cdd1e3d484941acb6f94b8a602407` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:10.546781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0cdd1e3d484941acb6f94b8a602407)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:10.548868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:10.593984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:10.626789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d6f9-dae3-4068-91ba-7c9b3a684b59 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:10.633934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d6f9-dae3-4068-91ba-7c9b3a684b59 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:10.633934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d6f9-dae3-4068-91ba-7c9b3a684b59 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:10.633934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 887/1779] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:35:10.671404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0cdd1e3d484941acb6f94b8a602407'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:10.672094 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0cdd1e3d484941acb6f94b8a602407'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:10.698631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0cdd1e3d484941acb6f94b8a602407'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:10.714622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0cdd1e3d484941acb6f94b8a602407'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:10.715672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0cdd1e3d484941acb6f94b8a602407'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:10.719269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9dabd-5d5d-4b13-ba60-730ce0ecaae4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:10.719806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9dabd-5d5d-4b13-ba60-730ce0ecaae4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:10.720274 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9dabd-5d5d-4b13-ba60-730ce0ecaae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:10.758592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 893/1780] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:10 2022] DELETE /identity/v3/users/4c0cdd1e3d484941acb6f94b8a602407 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:10.761832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:10.765709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:10.767533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c3f9dabd-5d5d-4b13-ba60-730ce0ecaae4 None None] MFA Rules not processed for user `96219eb4a7d649848ee4e700ae7a65f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:10.771150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3f9dabd-5d5d-4b13-ba60-730ce0ecaae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:10.821509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:10.920840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 888/1781] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:10.922502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257de641-7427-4c20-8f30-6b715d34ea8e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:10.922984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257de641-7427-4c20-8f30-6b715d34ea8e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:10.923415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257de641-7427-4c20-8f30-6b715d34ea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:11.026695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-257de641-7427-4c20-8f30-6b715d34ea8e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:11.043454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-257de641-7427-4c20-8f30-6b715d34ea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:11.088765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 889/1782] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:11.096277 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db6432-aaf7-4214-bd75-c2f7528009c0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:11.099654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db6432-aaf7-4214-bd75-c2f7528009c0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:11.099950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db6432-aaf7-4214-bd75-c2f7528009c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:11.102983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346241d-e9fd-4203-abbd-da5e0a6e755c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:11.151011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:11.151772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:11.154657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-50db6432-aaf7-4214-bd75-c2f7528009c0 None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:11.155130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:11.155590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] PATH_INFO: `/v3/projects/0d1f0fecdbba44ba898ebe8cad0cc4cd` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:11.160001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-50db6432-aaf7-4214-bd75-c2f7528009c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:11.162695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1f0fecdbba44ba898ebe8cad0cc4cd)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:11.164877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:11.309288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1f0fecdbba44ba898ebe8cad0cc4cd', 'request_id': 'req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:11.319407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1f0fecdbba44ba898ebe8cad0cc4cd', 'request_id': 'req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:11.335964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1f0fecdbba44ba898ebe8cad0cc4cd', 'request_id': 'req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:11.369081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] The token cache is being invalidate because project 0d1f0fecdbba44ba898ebe8cad0cc4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:11.369952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:11.372105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:11.378241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 894/1783] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:10 2022] DELETE /identity/v3/projects/0d1f0fecdbba44ba898ebe8cad0cc4cd => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:11.380175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:11.382338 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:11.484848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 890/1784] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:35:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:11.485868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db6432-aaf7-4214-bd75-c2f7528009c0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:11.499660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-50db6432-aaf7-4214-bd75-c2f7528009c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:11.532729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:11.655340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338e82e-5660-48aa-b6ad-3a04a9c4fdaf admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:11.673778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:11.674468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:11.674778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:11.675209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] PATH_INFO: `/v3/users/0b3ea3ceda8e44b48039c3e206e0028b` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:11.677833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3ea3ceda8e44b48039c3e206e0028b)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:11.679964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:11.691710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db6432-aaf7-4214-bd75-c2f7528009c0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:11.800727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3ea3ceda8e44b48039c3e206e0028b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:11.802689 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3ea3ceda8e44b48039c3e206e0028b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:11.854922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3ea3ceda8e44b48039c3e206e0028b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:11.864132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3ea3ceda8e44b48039c3e206e0028b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:11.864886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3ea3ceda8e44b48039c3e206e0028b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:11.894263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 895/1785] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:11 2022] DELETE /identity/v3/users/0b3ea3ceda8e44b48039c3e206e0028b => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:11.896642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:11.899765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:11.939284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dd29e-bbe7-4e88-b204-2f31f14e3c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:11.939938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dd29e-bbe7-4e88-b204-2f31f14e3c06 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:11.940224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dd29e-bbe7-4e88-b204-2f31f14e3c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:11.941493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dd29e-bbe7-4e88-b204-2f31f14e3c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:11.948013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8a1dd29e-bbe7-4e88-b204-2f31f14e3c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:11.982171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dd29e-bbe7-4e88-b204-2f31f14e3c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:11.986777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dd29e-bbe7-4e88-b204-2f31f14e3c06 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:12.013574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 891/1786] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:12.118304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bb3e8-3662-44d4-92e4-57bb47c5548d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:12.133400 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82343630-da65-4f5f-908a-950840429a64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:12.134346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82343630-da65-4f5f-908a-950840429a64 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:12.134666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82343630-da65-4f5f-908a-950840429a64 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:12.135255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82343630-da65-4f5f-908a-950840429a64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:12.137966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-82343630-da65-4f5f-908a-950840429a64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:12.171720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82343630-da65-4f5f-908a-950840429a64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:12.174324 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82343630-da65-4f5f-908a-950840429a64 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:12.197084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 896/1787] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:14.948806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dd29e-bbe7-4e88-b204-2f31f14e3c06 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:14.950923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8a1dd29e-bbe7-4e88-b204-2f31f14e3c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:14.970091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dd29e-bbe7-4e88-b204-2f31f14e3c06 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:15.031283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:15.073695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82343630-da65-4f5f-908a-950840429a64 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:15.075194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-82343630-da65-4f5f-908a-950840429a64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:15.232428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:15.233910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:15.236123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:15.236501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] PATH_INFO: `/v3/projects/0e72b44c099d493798552e14356f5a25` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:15.238347 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e72b44c099d493798552e14356f5a25)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:15.241595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:15.245289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:15.384359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82343630-da65-4f5f-908a-950840429a64 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:15.390423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:15.392186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:15.392507 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:15.393795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] PATH_INFO: `/v3/projects/f9c6e33455e548de89301105a7f4e3cd` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:15.395249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c6e33455e548de89301105a7f4e3cd)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:15.397619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:15.491170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c6e33455e548de89301105a7f4e3cd', 'request_id': 'req-338c725f-24fc-4b1a-8735-c532876f6976'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:15.500960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c6e33455e548de89301105a7f4e3cd', 'request_id': 'req-338c725f-24fc-4b1a-8735-c532876f6976'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:15.512953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c6e33455e548de89301105a7f4e3cd', 'request_id': 'req-338c725f-24fc-4b1a-8735-c532876f6976'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:15.537114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] The token cache is being invalidate because project f9c6e33455e548de89301105a7f4e3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:15.537114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:15.537978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:15.540450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 897/1788] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:15 2022] DELETE /identity/v3/projects/f9c6e33455e548de89301105a7f4e3cd => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:15.544898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:15.557270 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:15.604705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e72b44c099d493798552e14356f5a25', 'request_id': 'req-c6607cf9-5bfe-4616-be98-acd7a054d08c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:15.613180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e72b44c099d493798552e14356f5a25', 'request_id': 'req-c6607cf9-5bfe-4616-be98-acd7a054d08c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:15.625900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e72b44c099d493798552e14356f5a25', 'request_id': 'req-c6607cf9-5bfe-4616-be98-acd7a054d08c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:15.647833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] The token cache is being invalidate because project 0e72b44c099d493798552e14356f5a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:15.648212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:15.656235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c6607cf9-5bfe-4616-be98-acd7a054d08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:15.658315 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 892/1789] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:14 2022] DELETE /identity/v3/projects/0e72b44c099d493798552e14356f5a25 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:15.663655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2650e4-a9c6-47bf-82ae-f3b02215a657 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:15.664065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2650e4-a9c6-47bf-82ae-f3b02215a657 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:15.664479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2650e4-a9c6-47bf-82ae-f3b02215a657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:15.730850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2c2650e4-a9c6-47bf-82ae-f3b02215a657 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:15.730850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c2650e4-a9c6-47bf-82ae-f3b02215a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:15.812357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c725f-24fc-4b1a-8735-c532876f6976 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:16.004313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:16.015838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:16.015838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:16.015838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] PATH_INFO: `/v3/users/8e2b84a5574a41b795001d0ddd86cfe4` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:16.015838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2b84a5574a41b795001d0ddd86cfe4)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:16.015838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:16.018002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 893/1790] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:16.019010 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2650e4-a9c6-47bf-82ae-f3b02215a657 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:16.021362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c2650e4-a9c6-47bf-82ae-f3b02215a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:16.036429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2650e4-a9c6-47bf-82ae-f3b02215a657 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:16.049262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:16.058425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:16.059346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:16.059693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:16.060034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] PATH_INFO: `/v3/users/8f1d6aa1314940d08c41be02ae28ab56` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:16.061336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1d6aa1314940d08c41be02ae28ab56)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:16.063461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:16.163212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2b84a5574a41b795001d0ddd86cfe4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:16.163926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2b84a5574a41b795001d0ddd86cfe4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:16.194938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2b84a5574a41b795001d0ddd86cfe4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:16.195766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:16.220074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2b84a5574a41b795001d0ddd86cfe4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:16.220846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-1776eba7-1ae4-4383-b076-32f514917ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2b84a5574a41b795001d0ddd86cfe4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:16.229999 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1d6aa1314940d08c41be02ae28ab56'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:16.230990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1d6aa1314940d08c41be02ae28ab56'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:16.250728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 898/1791] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:15 2022] DELETE /identity/v3/users/8e2b84a5574a41b795001d0ddd86cfe4 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:16.252190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8b85d-eda2-4a02-b57c-6ca43f06e1ad None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:16.252401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8b85d-eda2-4a02-b57c-6ca43f06e1ad None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:16.252683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8b85d-eda2-4a02-b57c-6ca43f06e1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:16.267400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1d6aa1314940d08c41be02ae28ab56'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:16.268091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1d6aa1314940d08c41be02ae28ab56'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:16.310531 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-85d8b85d-eda2-4a02-b57c-6ca43f06e1ad None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:16.311830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-85d8b85d-eda2-4a02-b57c-6ca43f06e1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:16.317861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d23fb497-9521-49d4-a41d-72258c879234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1d6aa1314940d08c41be02ae28ab56'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:16.372466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 894/1792] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:16 2022] DELETE /identity/v3/users/8f1d6aa1314940d08c41be02ae28ab56 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:16.373862 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4186891-09e4-46a5-a7bd-207a6fcf0406 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:16.374149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4186891-09e4-46a5-a7bd-207a6fcf0406 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:16.374424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4186891-09e4-46a5-a7bd-207a6fcf0406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:16.419471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a4186891-09e4-46a5-a7bd-207a6fcf0406 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:16.423275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a4186891-09e4-46a5-a7bd-207a6fcf0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:16.497213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 899/1793] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:16.502005 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8b85d-eda2-4a02-b57c-6ca43f06e1ad None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:16.534371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8b85d-eda2-4a02-b57c-6ca43f06e1ad None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:16.595264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 895/1794] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:16.633103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4186891-09e4-46a5-a7bd-207a6fcf0406 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:16.635398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a4186891-09e4-46a5-a7bd-207a6fcf0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:16.794137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524a43-b4b6-4bac-b4a2-bd4254c4f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:16.802058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524a43-b4b6-4bac-b4a2-bd4254c4f570 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:16.802437 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524a43-b4b6-4bac-b4a2-bd4254c4f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:16.804824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524a43-b4b6-4bac-b4a2-bd4254c4f570 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:16.805807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524a43-b4b6-4bac-b4a2-bd4254c4f570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:16.805936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524a43-b4b6-4bac-b4a2-bd4254c4f570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:16.808439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524a43-b4b6-4bac-b4a2-bd4254c4f570 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:16.843713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 900/1795] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:16.845151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524a43-b4b6-4bac-b4a2-bd4254c4f570 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:16.864343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524a43-b4b6-4bac-b4a2-bd4254c4f570 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:16.879444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff64f-9b41-4764-8e4a-d3ae7424cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:16.882654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff64f-9b41-4764-8e4a-d3ae7424cc0b admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:16.882654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff64f-9b41-4764-8e4a-d3ae7424cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:16.882654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff64f-9b41-4764-8e4a-d3ae7424cc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:16.882654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ff64f-9b41-4764-8e4a-d3ae7424cc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:16.890145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ff64f-9b41-4764-8e4a-d3ae7424cc0b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:16.910719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4186891-09e4-46a5-a7bd-207a6fcf0406 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:16.921931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69539f0c-7f01-4654-87bf-f96ec70629e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:16.922575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69539f0c-7f01-4654-87bf-f96ec70629e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:16.924244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69539f0c-7f01-4654-87bf-f96ec70629e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:16.924540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69539f0c-7f01-4654-87bf-f96ec70629e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:16.948439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:16.955037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69539f0c-7f01-4654-87bf-f96ec70629e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:16.959549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69539f0c-7f01-4654-87bf-f96ec70629e2 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:16.970062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 901/1796] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:16 2022] POST /identity/v3/projects => generated 361 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:16.972914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff64f-9b41-4764-8e4a-d3ae7424cc0b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:16.992854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 896/1797] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:17.051084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69539f0c-7f01-4654-87bf-f96ec70629e2 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:17.053159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69539f0c-7f01-4654-87bf-f96ec70629e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:17.075024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69539f0c-7f01-4654-87bf-f96ec70629e2 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:17.086666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:17.088073 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:17.088367 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:17.089188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff64f-9b41-4764-8e4a-d3ae7424cc0b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:17.090001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] PATH_INFO: `/v3/users/163c5f907b894341b89734ed67fbcd19` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:17.091689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=163c5f907b894341b89734ed67fbcd19)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:17.096723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:17.101545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c98041-16c6-48e9-b21f-2d86c02c44e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:17.102182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c98041-16c6-48e9-b21f-2d86c02c44e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:17.104100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c98041-16c6-48e9-b21f-2d86c02c44e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:17.105684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c98041-16c6-48e9-b21f-2d86c02c44e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:17.106376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c98041-16c6-48e9-b21f-2d86c02c44e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:17.112097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c98041-16c6-48e9-b21f-2d86c02c44e9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:17.165409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 902/1798] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:16 2022] POST /identity/v3/users => generated 281 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:17.173186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c98041-16c6-48e9-b21f-2d86c02c44e9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:17.202183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c98041-16c6-48e9-b21f-2d86c02c44e9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:17.219679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db529d-a266-4855-9419-8746d867770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:17.220650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163c5f907b894341b89734ed67fbcd19'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:17.221985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163c5f907b894341b89734ed67fbcd19'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:17.222286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db529d-a266-4855-9419-8746d867770d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:17.222614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db529d-a266-4855-9419-8746d867770d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:17.223782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db529d-a266-4855-9419-8746d867770d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:17.224530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db529d-a266-4855-9419-8746d867770d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:17.227306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db529d-a266-4855-9419-8746d867770d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:17.245894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 903/1799] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:17.246902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163c5f907b894341b89734ed67fbcd19'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:17.247165 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db529d-a266-4855-9419-8746d867770d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:17.248274 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163c5f907b894341b89734ed67fbcd19'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:17.250117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:17.258756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db529d-a266-4855-9419-8746d867770d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:17.267447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44670a-e300-4945-add6-0568f4df47e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:17.268317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44670a-e300-4945-add6-0568f4df47e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:17.268612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44670a-e300-4945-add6-0568f4df47e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:17.268918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44670a-e300-4945-add6-0568f4df47e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:17.269871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44670a-e300-4945-add6-0568f4df47e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:17.271813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44670a-e300-4945-add6-0568f4df47e0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:17.286499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 904/1800] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:17.292341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30d64645-d7c7-41bc-b7fd-0b6c7ab0d8bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163c5f907b894341b89734ed67fbcd19'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:17.292796 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44670a-e300-4945-add6-0568f4df47e0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:17.294922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-de44670a-e300-4945-add6-0568f4df47e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:17.320924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 897/1801] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:17 2022] DELETE /identity/v3/users/163c5f907b894341b89734ed67fbcd19 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:17.324067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44670a-e300-4945-add6-0568f4df47e0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:17.325481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038dc28-09be-4527-984f-2634940fb51a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:17.326160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038dc28-09be-4527-984f-2634940fb51a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:17.327268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038dc28-09be-4527-984f-2634940fb51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:17.434442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b724e71-ee45-492f-b01d-57939d7ad692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:17.438309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b724e71-ee45-492f-b01d-57939d7ad692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:17.438903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b724e71-ee45-492f-b01d-57939d7ad692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:17.439448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b724e71-ee45-492f-b01d-57939d7ad692 admin admin] PATH_INFO: `/v3/projects/3807b98dc1b3435a931085f117128bb3/users/1fb43b4e146940df982d9bf9f9711196/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:17.441229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c038dc28-09be-4527-984f-2634940fb51a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:17.444880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c038dc28-09be-4527-984f-2634940fb51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:17.470998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 898/1802] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:17.506788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b724e71-ee45-492f-b01d-57939d7ad692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807b98dc1b3435a931085f117128bb3, user_id=1fb43b4e146940df982d9bf9f9711196, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:17.518869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b724e71-ee45-492f-b01d-57939d7ad692 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:17.577277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 905/1803] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:17 2022] PUT /identity/v3/projects/3807b98dc1b3435a931085f117128bb3/users/1fb43b4e146940df982d9bf9f9711196/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:17.578029 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c46fb4-f72d-448f-bc77-2a35e01cda98 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:17.578378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c46fb4-f72d-448f-bc77-2a35e01cda98 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:17.578662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c46fb4-f72d-448f-bc77-2a35e01cda98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:17.652680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f3c46fb4-f72d-448f-bc77-2a35e01cda98 None None] MFA Rules not processed for user `1fb43b4e146940df982d9bf9f9711196`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:17.653810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f3c46fb4-f72d-448f-bc77-2a35e01cda98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:17.659059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b724e71-ee45-492f-b01d-57939d7ad692 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:17.663471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9b724e71-ee45-492f-b01d-57939d7ad692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:17.797375 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 899/1804] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:17.798829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daaaa6-afa2-482d-aaed-9d9d6f0f7f88 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:17.799220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daaaa6-afa2-482d-aaed-9d9d6f0f7f88 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:17.799720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daaaa6-afa2-482d-aaed-9d9d6f0f7f88 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:17.818311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 900/1805] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:35:17 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:17.845813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33daaaa6-afa2-482d-aaed-9d9d6f0f7f88 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:17.847556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-33daaaa6-afa2-482d-aaed-9d9d6f0f7f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:17.850832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b724e71-ee45-492f-b01d-57939d7ad692 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:17.877939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac4487-9995-48c9-b677-3582ee64fd54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:17.878576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac4487-9995-48c9-b677-3582ee64fd54 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:17.878879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac4487-9995-48c9-b677-3582ee64fd54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:17.879150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac4487-9995-48c9-b677-3582ee64fd54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:17.905319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:18.039577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33daaaa6-afa2-482d-aaed-9d9d6f0f7f88 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:18.050243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5435cf-5f09-400a-8124-087297683075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:18.051830 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5435cf-5f09-400a-8124-087297683075 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.053095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5435cf-5f09-400a-8124-087297683075 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.053676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5435cf-5f09-400a-8124-087297683075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.068343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5435cf-5f09-400a-8124-087297683075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:18.070331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5435cf-5f09-400a-8124-087297683075 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:18.082196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 901/1806] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:18.084358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87cc89-563c-40c7-843e-dc092beae1de None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.084865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87cc89-563c-40c7-843e-dc092beae1de None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.085428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87cc89-563c-40c7-843e-dc092beae1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.104411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac4487-9995-48c9-b677-3582ee64fd54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:18.105877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac4487-9995-48c9-b677-3582ee64fd54 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:18.114935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4e87cc89-563c-40c7-843e-dc092beae1de None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:18.116540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4e87cc89-563c-40c7-843e-dc092beae1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:18.141525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 906/1807] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:18.142484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac4487-9995-48c9-b677-3582ee64fd54 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:18.169149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac4487-9995-48c9-b677-3582ee64fd54 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:18.187793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:18.188420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.188702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.188976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] PATH_INFO: `/v3/users/1fb43b4e146940df982d9bf9f9711196` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.195652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb43b4e146940df982d9bf9f9711196)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:18.198286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:18.245413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:18.331441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 902/1808] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:35:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:18.334257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb43b4e146940df982d9bf9f9711196'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:18.335444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb43b4e146940df982d9bf9f9711196'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:18.376425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb43b4e146940df982d9bf9f9711196'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:18.411675 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb43b4e146940df982d9bf9f9711196'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:18.414970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb43b4e146940df982d9bf9f9711196'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:18.469826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 907/1809] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:18 2022] DELETE /identity/v3/users/1fb43b4e146940df982d9bf9f9711196 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:18.474418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583eaee-5602-4468-82b7-dccece416459 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.475036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583eaee-5602-4468-82b7-dccece416459 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.475624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583eaee-5602-4468-82b7-dccece416459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.532298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e583eaee-5602-4468-82b7-dccece416459 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:18.541560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e583eaee-5602-4468-82b7-dccece416459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:18.683896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:18.685611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:18.744218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 903/1810] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:18.843961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583eaee-5602-4468-82b7-dccece416459 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:18.845892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e583eaee-5602-4468-82b7-dccece416459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:18.851317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76501c-b0d6-45d9-9377-9712dac44fdf admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:18.874225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29302b-d337-4f57-b849-6d41f7e29f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:18.882281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29302b-d337-4f57-b849-6d41f7e29f4c service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.882281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29302b-d337-4f57-b849-6d41f7e29f4c service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.882281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29302b-d337-4f57-b849-6d41f7e29f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.882281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ca29302b-d337-4f57-b849-6d41f7e29f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:18.913055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29302b-d337-4f57-b849-6d41f7e29f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:18.914958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29302b-d337-4f57-b849-6d41f7e29f4c service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:18.920508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:18.963680 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 908/1811] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:19.017184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29302b-d337-4f57-b849-6d41f7e29f4c service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.018892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ca29302b-d337-4f57-b849-6d41f7e29f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:19.039819 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583eaee-5602-4468-82b7-dccece416459 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.051817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d399c3-b0c6-46f6-ac45-456f8177b0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.052960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d399c3-b0c6-46f6-ac45-456f8177b0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.053563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29302b-d337-4f57-b849-6d41f7e29f4c service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.054177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d399c3-b0c6-46f6-ac45-456f8177b0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.056161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d399c3-b0c6-46f6-ac45-456f8177b0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.069039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.071387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.071387 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.072573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] PATH_INFO: `/v3/projects/e7f9b5fd0ab042aa91db659e83c58fbb` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.077574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f9b5fd0ab042aa91db659e83c58fbb)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.080055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.095448 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d399c3-b0c6-46f6-ac45-456f8177b0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.096980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d399c3-b0c6-46f6-ac45-456f8177b0b5 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.113651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 904/1812] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:19.170741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f9b5fd0ab042aa91db659e83c58fbb', 'request_id': 'req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.179199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f9b5fd0ab042aa91db659e83c58fbb', 'request_id': 'req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.187609 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f9b5fd0ab042aa91db659e83c58fbb', 'request_id': 'req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.203900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] The token cache is being invalidate because project e7f9b5fd0ab042aa91db659e83c58fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:19.204314 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.206158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.208031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 909/1813] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:19 2022] DELETE /identity/v3/projects/e7f9b5fd0ab042aa91db659e83c58fbb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:19.216512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b92a-e7b0-48ea-9f18-ae546373a6f1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.217191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b92a-e7b0-48ea-9f18-ae546373a6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.217767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b92a-e7b0-48ea-9f18-ae546373a6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.246643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f255b92a-e7b0-48ea-9f18-ae546373a6f1 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:19.247907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f255b92a-e7b0-48ea-9f18-ae546373a6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:19.313650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.315463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:19.357820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 905/1814] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:19.368762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3b46f-b9e6-4302-a461-fa3f08783a05 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.369885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3b46f-b9e6-4302-a461-fa3f08783a05 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.370067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3b46f-b9e6-4302-a461-fa3f08783a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.393725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-15c3b46f-b9e6-4302-a461-fa3f08783a05 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:19.395159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-15c3b46f-b9e6-4302-a461-fa3f08783a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:19.406509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 906/1815] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:19.411494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3b46f-b9e6-4302-a461-fa3f08783a05 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.414890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c7ed-a50e-458f-b2ff-51301b9e3ee8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.421973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.422809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.423593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.423876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] PATH_INFO: `/v3/projects/a355b5786ce84c8c8621dbdbe9b1a514` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.424328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3b46f-b9e6-4302-a461-fa3f08783a05 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.425201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a355b5786ce84c8c8621dbdbe9b1a514)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.427632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.436855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af532d-e940-470e-bb70-321c49405db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.438963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af532d-e940-470e-bb70-321c49405db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.439521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af532d-e940-470e-bb70-321c49405db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.439955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af532d-e940-470e-bb70-321c49405db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.440981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af532d-e940-470e-bb70-321c49405db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:19.441455 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af532d-e940-470e-bb70-321c49405db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.444182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af532d-e940-470e-bb70-321c49405db7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.458613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 907/1816] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:19.463851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af532d-e940-470e-bb70-321c49405db7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.512006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af532d-e940-470e-bb70-321c49405db7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.519134 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a355b5786ce84c8c8621dbdbe9b1a514', 'request_id': 'req-3c54029e-a0b2-4430-9404-00ba054b8b27'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.528984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a355b5786ce84c8c8621dbdbe9b1a514', 'request_id': 'req-3c54029e-a0b2-4430-9404-00ba054b8b27'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.536526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a355b5786ce84c8c8621dbdbe9b1a514', 'request_id': 'req-3c54029e-a0b2-4430-9404-00ba054b8b27'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.538446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:19.555613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] The token cache is being invalidate because project a355b5786ce84c8c8621dbdbe9b1a514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:19.556725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.558097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.564183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 910/1817] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:19 2022] DELETE /identity/v3/projects/a355b5786ce84c8c8621dbdbe9b1a514 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:19.568088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.570112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:19.589376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:19.613133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025764f-a328-48b7-975b-60cdeba5c104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.614499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025764f-a328-48b7-975b-60cdeba5c104 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.615033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025764f-a328-48b7-975b-60cdeba5c104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.615683 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025764f-a328-48b7-975b-60cdeba5c104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.616428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025764f-a328-48b7-975b-60cdeba5c104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.620005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025764f-a328-48b7-975b-60cdeba5c104 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.670048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54029e-a0b2-4430-9404-00ba054b8b27 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.676429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.677313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.677761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.678176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] PATH_INFO: `/v3/users/863892696d94404fa2e82ab3c0b038ed` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.678336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 908/1818] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:19 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:19.682962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025764f-a328-48b7-975b-60cdeba5c104 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.684964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c025764f-a328-48b7-975b-60cdeba5c104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:19.685874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=863892696d94404fa2e82ab3c0b038ed)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.691160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.810150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025764f-a328-48b7-975b-60cdeba5c104 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.817788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863892696d94404fa2e82ab3c0b038ed'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.819987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863892696d94404fa2e82ab3c0b038ed'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.834561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765d6f6-a3cc-4b97-9ed4-df68370b1714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.835418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765d6f6-a3cc-4b97-9ed4-df68370b1714 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.836888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765d6f6-a3cc-4b97-9ed4-df68370b1714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.837342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765d6f6-a3cc-4b97-9ed4-df68370b1714 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.840738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765d6f6-a3cc-4b97-9ed4-df68370b1714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.844416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863892696d94404fa2e82ab3c0b038ed'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.847855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765d6f6-a3cc-4b97-9ed4-df68370b1714 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.858701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863892696d94404fa2e82ab3c0b038ed'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.860351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863892696d94404fa2e82ab3c0b038ed'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:19.883118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 911/1819] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:19 2022] DELETE /identity/v3/users/863892696d94404fa2e82ab3c0b038ed => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:19.904945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 909/1820] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:19 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:19.910351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.914600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:19.920660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765d6f6-a3cc-4b97-9ed4-df68370b1714 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.922628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3765d6f6-a3cc-4b97-9ed4-df68370b1714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:19.949492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765d6f6-a3cc-4b97-9ed4-df68370b1714 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:20.061833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a190-ffc6-436f-97fc-2005dd610c8f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:20.072618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9cf38-9096-4b46-bdec-59ec9b540505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:20.073446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cf38-9096-4b46-bdec-59ec9b540505 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.073779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cf38-9096-4b46-bdec-59ec9b540505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.074062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cf38-9096-4b46-bdec-59ec9b540505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.074961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9cf38-9096-4b46-bdec-59ec9b540505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:20.077020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9cf38-9096-4b46-bdec-59ec9b540505 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:20.090200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 912/1821] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:20.091533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9cf38-9096-4b46-bdec-59ec9b540505 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:20.093629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ccc9cf38-9096-4b46-bdec-59ec9b540505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:20.113980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:20.114654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.114965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.115320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] PATH_INFO: `/v3/projects/26ad9e2eb6824a2092603f5b6a7242b2` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.117856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ad9e2eb6824a2092603f5b6a7242b2)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:20.120022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:20.127863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9cf38-9096-4b46-bdec-59ec9b540505 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:20.133479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:20.134328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.134707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.135056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] PATH_INFO: `/v3/projects/3807b98dc1b3435a931085f117128bb3` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.136722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3807b98dc1b3435a931085f117128bb3)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:20.140117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:20.163829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:20.180067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:20.204096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ad9e2eb6824a2092603f5b6a7242b2', 'request_id': 'req-9d197267-5a94-498f-ab6c-1895467dc149'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.213534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ad9e2eb6824a2092603f5b6a7242b2', 'request_id': 'req-9d197267-5a94-498f-ab6c-1895467dc149'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.221548 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3807b98dc1b3435a931085f117128bb3', 'request_id': 'req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.224439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ad9e2eb6824a2092603f5b6a7242b2', 'request_id': 'req-9d197267-5a94-498f-ab6c-1895467dc149'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.231822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3807b98dc1b3435a931085f117128bb3', 'request_id': 'req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.240943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3807b98dc1b3435a931085f117128bb3', 'request_id': 'req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.244394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] The token cache is being invalidate because project 26ad9e2eb6824a2092603f5b6a7242b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:20.244761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.245691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.247595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 910/1822] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:19 2022] DELETE /identity/v3/projects/26ad9e2eb6824a2092603f5b6a7242b2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:20.248637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:20.251049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:20.261415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] The token cache is being invalidate because project 3807b98dc1b3435a931085f117128bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:20.261972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.263163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.267386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 913/1823] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:20 2022] DELETE /identity/v3/projects/3807b98dc1b3435a931085f117128bb3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:20.268614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:20.269601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:20.360902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215948f-a249-4ee8-9ddb-2ff2cb7db99f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:20.364573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197267-5a94-498f-ab6c-1895467dc149 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:20.368179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:20.369335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.372619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.372895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] PATH_INFO: `/v3/users/8ab914528327408ab42db9807ead4cdf` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.373796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ee560-f300-40e1-8f63-40c4a1eca38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:20.374618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab914528327408ab42db9807ead4cdf)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:20.374767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee560-f300-40e1-8f63-40c4a1eca38a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.375062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee560-f300-40e1-8f63-40c4a1eca38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.375402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee560-f300-40e1-8f63-40c4a1eca38a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.376159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ee560-f300-40e1-8f63-40c4a1eca38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:20.376681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:20.378589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ee560-f300-40e1-8f63-40c4a1eca38a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:20.406631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 911/1824] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:20.406631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9c5e4-bd78-498d-903e-6b9cfc988234 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.406631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9c5e4-bd78-498d-903e-6b9cfc988234 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.406631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9c5e4-bd78-498d-903e-6b9cfc988234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.429731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d7a9c5e4-bd78-498d-903e-6b9cfc988234 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:20.431344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d7a9c5e4-bd78-498d-903e-6b9cfc988234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:20.440494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 912/1825] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:20.441429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9c5e4-bd78-498d-903e-6b9cfc988234 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:20.443214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d7a9c5e4-bd78-498d-903e-6b9cfc988234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:20.456956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab914528327408ab42db9807ead4cdf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.457993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab914528327408ab42db9807ead4cdf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.466100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9c5e4-bd78-498d-903e-6b9cfc988234 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:20.471487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:20.472157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.472435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.472729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] PATH_INFO: `/v3/projects/3d9d6d5ec96f48f3bb3c4cf5372eae65` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.473842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9d6d5ec96f48f3bb3c4cf5372eae65)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:20.476334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:20.476457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab914528327408ab42db9807ead4cdf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.485730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab914528327408ab42db9807ead4cdf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.486446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab914528327408ab42db9807ead4cdf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.501916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 914/1826] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:20 2022] DELETE /identity/v3/users/8ab914528327408ab42db9807ead4cdf => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:20.502846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:20.504771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:20.536084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9d6d5ec96f48f3bb3c4cf5372eae65', 'request_id': 'req-dcc8e7ac-d011-4689-a59f-616cdbe3d414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.543418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9d6d5ec96f48f3bb3c4cf5372eae65', 'request_id': 'req-dcc8e7ac-d011-4689-a59f-616cdbe3d414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.546484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:20.552275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9d6d5ec96f48f3bb3c4cf5372eae65', 'request_id': 'req-dcc8e7ac-d011-4689-a59f-616cdbe3d414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.567827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] The token cache is being invalidate because project 3d9d6d5ec96f48f3bb3c4cf5372eae65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:20.568124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.568864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dcc8e7ac-d011-4689-a59f-616cdbe3d414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:20.571409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 913/1827] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:20 2022] DELETE /identity/v3/projects/3d9d6d5ec96f48f3bb3c4cf5372eae65 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:20.576203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb312-f864-48bf-97f5-49b67fe148ae None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.576494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb312-f864-48bf-97f5-49b67fe148ae None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.576773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb312-f864-48bf-97f5-49b67fe148ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.589204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcb577-95b6-45c7-ae6a-3722e69dd729 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:20.601360 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ff9bb312-f864-48bf-97f5-49b67fe148ae None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:20.602581 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ff9bb312-f864-48bf-97f5-49b67fe148ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:20.639520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:20.671503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1e003-7a98-4a69-81ca-c6127c01d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:20.672183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1e003-7a98-4a69-81ca-c6127c01d813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.672475 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1e003-7a98-4a69-81ca-c6127c01d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.672741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1e003-7a98-4a69-81ca-c6127c01d813 admin admin] PATH_INFO: `/v3/projects/9d2e753b77a24af79d0ba81b3663f531/users/82aa6039a5254c628e6a0bac01f676fc/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.681983 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 914/1828] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:20.684026 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7c70a-f3ef-43d5-92b2-436fd9d80138 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.684379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7c70a-f3ef-43d5-92b2-436fd9d80138 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.685011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7c70a-f3ef-43d5-92b2-436fd9d80138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.711970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1e003-7a98-4a69-81ca-c6127c01d813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2e753b77a24af79d0ba81b3663f531, user_id=82aa6039a5254c628e6a0bac01f676fc, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:20.715395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1e003-7a98-4a69-81ca-c6127c01d813 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:20.721654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7fb7c70a-f3ef-43d5-92b2-436fd9d80138 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:20.723116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7fb7c70a-f3ef-43d5-92b2-436fd9d80138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:20.735049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 915/1829] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:20 2022] PUT /identity/v3/projects/9d2e753b77a24af79d0ba81b3663f531/users/82aa6039a5254c628e6a0bac01f676fc/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:20.735049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1e003-7a98-4a69-81ca-c6127c01d813 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:20.817873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 915/1830] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:20.817873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69366a17-e98b-4849-a975-f89124a05454 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.817873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69366a17-e98b-4849-a975-f89124a05454 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.818211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69366a17-e98b-4849-a975-f89124a05454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.819152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1e003-7a98-4a69-81ca-c6127c01d813 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:20.824782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd017352-17f1-4483-b38b-eed6ebccfac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:20.825504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017352-17f1-4483-b38b-eed6ebccfac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.825792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017352-17f1-4483-b38b-eed6ebccfac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.826064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017352-17f1-4483-b38b-eed6ebccfac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.826848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd017352-17f1-4483-b38b-eed6ebccfac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:20.827108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd017352-17f1-4483-b38b-eed6ebccfac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:20.830101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd017352-17f1-4483-b38b-eed6ebccfac6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:20.852256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-69366a17-e98b-4849-a975-f89124a05454 None None] MFA Rules not processed for user `82aa6039a5254c628e6a0bac01f676fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:20.853156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 916/1831] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:20.853759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69366a17-e98b-4849-a975-f89124a05454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:20.855391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2d68b-524d-4db5-9559-7178c323e471 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.856138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2d68b-524d-4db5-9559-7178c323e471 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.856698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2d68b-524d-4db5-9559-7178c323e471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.889670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f1f2d68b-524d-4db5-9559-7178c323e471 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:20.891748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f1f2d68b-524d-4db5-9559-7178c323e471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:20.906315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 917/1832] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:20.907498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2d68b-524d-4db5-9559-7178c323e471 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:20.924555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2d68b-524d-4db5-9559-7178c323e471 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:20.938834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a7d9d-9f33-40d9-8867-99102d85692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:20.939276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a7d9d-9f33-40d9-8867-99102d85692b admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.939552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a7d9d-9f33-40d9-8867-99102d85692b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.939819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a7d9d-9f33-40d9-8867-99102d85692b admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.940452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a7d9d-9f33-40d9-8867-99102d85692b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:20.942628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a7d9d-9f33-40d9-8867-99102d85692b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:20.953223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 916/1833] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:20.954179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69366a17-e98b-4849-a975-f89124a05454 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:20.978511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69366a17-e98b-4849-a975-f89124a05454 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:20.984803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148458f-60f6-4aef-ac94-9dd5daf82e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:20.985434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148458f-60f6-4aef-ac94-9dd5daf82e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:20.985716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148458f-60f6-4aef-ac94-9dd5daf82e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:20.986379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148458f-60f6-4aef-ac94-9dd5daf82e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:20.987268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148458f-60f6-4aef-ac94-9dd5daf82e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:20.987583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148458f-60f6-4aef-ac94-9dd5daf82e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:20.987698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 918/1834] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:20 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:20.988609 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a7d9d-9f33-40d9-8867-99102d85692b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:20.989335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148458f-60f6-4aef-ac94-9dd5daf82e72 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:20.990321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cc6a7d9d-9f33-40d9-8867-99102d85692b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:21.007268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 917/1835] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:21.008414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148458f-60f6-4aef-ac94-9dd5daf82e72 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.030391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:21.031540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148458f-60f6-4aef-ac94-9dd5daf82e72 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.102439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:21.102571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a7d9d-9f33-40d9-8867-99102d85692b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.110163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea68ed-3f1f-489e-9698-37ee2fac4a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.110819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea68ed-3f1f-489e-9698-37ee2fac4a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.111105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea68ed-3f1f-489e-9698-37ee2fac4a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.111490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea68ed-3f1f-489e-9698-37ee2fac4a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.112757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea68ed-3f1f-489e-9698-37ee2fac4a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.113014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9792ee-80a1-4a6c-bbd9-34e5c66e14f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.113720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9792ee-80a1-4a6c-bbd9-34e5c66e14f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.113963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9792ee-80a1-4a6c-bbd9-34e5c66e14f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.114153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea68ed-3f1f-489e-9698-37ee2fac4a36 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.114264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9792ee-80a1-4a6c-bbd9-34e5c66e14f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.115137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9792ee-80a1-4a6c-bbd9-34e5c66e14f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.117281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9792ee-80a1-4a6c-bbd9-34e5c66e14f0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.152510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 918/1836] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:21 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:21.152510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9792ee-80a1-4a6c-bbd9-34e5c66e14f0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.152714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 919/1837] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:20 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:21.152714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea68ed-3f1f-489e-9698-37ee2fac4a36 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.154193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2cea68ed-3f1f-489e-9698-37ee2fac4a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:21.161471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9792ee-80a1-4a6c-bbd9-34e5c66e14f0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.222770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea68ed-3f1f-489e-9698-37ee2fac4a36 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.227485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.228208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.228589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.228865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] PATH_INFO: `/v3/projects/e955bfc84fa24c36bec15b910c9ca255` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.229982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638e995-e730-4c87-bd3f-f6498e110258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.230125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e955bfc84fa24c36bec15b910c9ca255)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.230593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638e995-e730-4c87-bd3f-f6498e110258 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.230908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638e995-e730-4c87-bd3f-f6498e110258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.231215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638e995-e730-4c87-bd3f-f6498e110258 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.231807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638e995-e730-4c87-bd3f-f6498e110258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.231912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.233706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638e995-e730-4c87-bd3f-f6498e110258 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.266788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 919/1838] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:21 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:21.266788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638e995-e730-4c87-bd3f-f6498e110258 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.282620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e955bfc84fa24c36bec15b910c9ca255', 'request_id': 'req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:21.289529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e955bfc84fa24c36bec15b910c9ca255', 'request_id': 'req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:21.295941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e955bfc84fa24c36bec15b910c9ca255', 'request_id': 'req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:21.310808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] The token cache is being invalidate because project e955bfc84fa24c36bec15b910c9ca255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:21.311149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:21.312172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:21.318294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 920/1839] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:21 2022] DELETE /identity/v3/projects/e955bfc84fa24c36bec15b910c9ca255 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:21.319489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.320979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:21.334942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638e995-e730-4c87-bd3f-f6498e110258 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.376284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:21.400696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089947b-7aaf-4ee8-840c-dfcc29b30d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.401393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089947b-7aaf-4ee8-840c-dfcc29b30d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.401738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089947b-7aaf-4ee8-840c-dfcc29b30d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.402077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089947b-7aaf-4ee8-840c-dfcc29b30d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.402859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089947b-7aaf-4ee8-840c-dfcc29b30d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.403820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e5a8e-6068-40c3-ae9e-a7d5cb9a1a36 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.404600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089947b-7aaf-4ee8-840c-dfcc29b30d58 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.410040 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e56bfd-f178-4a8a-b670-7754aba8ebc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.411389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e56bfd-f178-4a8a-b670-7754aba8ebc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.411672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e56bfd-f178-4a8a-b670-7754aba8ebc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.411945 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e56bfd-f178-4a8a-b670-7754aba8ebc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.412585 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e56bfd-f178-4a8a-b670-7754aba8ebc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.414517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e56bfd-f178-4a8a-b670-7754aba8ebc2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.419153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 920/1840] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:21.419153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089947b-7aaf-4ee8-840c-dfcc29b30d58 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.419153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4089947b-7aaf-4ee8-840c-dfcc29b30d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:21.432975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089947b-7aaf-4ee8-840c-dfcc29b30d58 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.438483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23706150-689a-42b4-bfe9-119a926589da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.439131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23706150-689a-42b4-bfe9-119a926589da admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.439418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23706150-689a-42b4-bfe9-119a926589da admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.439690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23706150-689a-42b4-bfe9-119a926589da admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.441892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 921/1841] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:21 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:21.442033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23706150-689a-42b4-bfe9-119a926589da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.442201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12ef86-b7ac-4548-b3db-8b475ce8ebc2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.442201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12ef86-b7ac-4548-b3db-8b475ce8ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.442346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12ef86-b7ac-4548-b3db-8b475ce8ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.442524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23706150-689a-42b4-bfe9-119a926589da admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.452835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:21.477721 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 921/1842] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:21 2022] POST /identity/v3/users => generated 293 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:21.480740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ea12ef86-b7ac-4548-b3db-8b475ce8ebc2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:21.482214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ea12ef86-b7ac-4548-b3db-8b475ce8ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:21.482466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23706150-689a-42b4-bfe9-119a926589da admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.484138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-23706150-689a-42b4-bfe9-119a926589da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:21.492586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 922/1843] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:21.494455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12ef86-b7ac-4548-b3db-8b475ce8ebc2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.497333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23706150-689a-42b4-bfe9-119a926589da admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.502406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9cb69-892d-4ad5-9460-4f1ffcc98f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.503048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9cb69-892d-4ad5-9460-4f1ffcc98f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.503329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9cb69-892d-4ad5-9460-4f1ffcc98f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.503609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9cb69-892d-4ad5-9460-4f1ffcc98f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.504281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9cb69-892d-4ad5-9460-4f1ffcc98f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.505017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12ef86-b7ac-4548-b3db-8b475ce8ebc2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.505874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9cb69-892d-4ad5-9460-4f1ffcc98f80 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.509863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2760d-a56d-4bef-941b-0b54b029badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.510491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2760d-a56d-4bef-941b-0b54b029badf admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.510809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2760d-a56d-4bef-941b-0b54b029badf admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.511123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2760d-a56d-4bef-941b-0b54b029badf admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.511771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2760d-a56d-4bef-941b-0b54b029badf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.513357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2760d-a56d-4bef-941b-0b54b029badf admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.522086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 922/1844] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:21.522086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9cb69-892d-4ad5-9460-4f1ffcc98f80 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.526735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 923/1845] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:21.529823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d50af-9169-427d-a3c0-84c46e7414dd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.529823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d50af-9169-427d-a3c0-84c46e7414dd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.529823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d50af-9169-427d-a3c0-84c46e7414dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.537801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9cb69-892d-4ad5-9460-4f1ffcc98f80 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.548027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e90d50af-9169-427d-a3c0-84c46e7414dd None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:21.549251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e90d50af-9169-427d-a3c0-84c46e7414dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:21.552450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3661e-cfc6-4ee2-af47-fe2cb162d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.553790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3661e-cfc6-4ee2-af47-fe2cb162d27a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.554078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3661e-cfc6-4ee2-af47-fe2cb162d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.554470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3661e-cfc6-4ee2-af47-fe2cb162d27a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.555205 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3661e-cfc6-4ee2-af47-fe2cb162d27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.557646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3661e-cfc6-4ee2-af47-fe2cb162d27a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.562085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 924/1846] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:21.562085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d50af-9169-427d-a3c0-84c46e7414dd None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.570053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d50af-9169-427d-a3c0-84c46e7414dd None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.575069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba3b9e-1804-4518-bc6d-6231c9917a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.575715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba3b9e-1804-4518-bc6d-6231c9917a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.576021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba3b9e-1804-4518-bc6d-6231c9917a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.578919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 923/1847] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:21.579051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba3b9e-1804-4518-bc6d-6231c9917a0f admin admin] PATH_INFO: `/v3/projects/941997f468fb4d8686d29911a0cd2f8f/users/fa7546fad5fe40819971fb1808d51965/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.579146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3661e-cfc6-4ee2-af47-fe2cb162d27a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.586754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3661e-cfc6-4ee2-af47-fe2cb162d27a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.591853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb760-4081-4f0a-9ae2-52ce16718799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.591988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba3b9e-1804-4518-bc6d-6231c9917a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=941997f468fb4d8686d29911a0cd2f8f, user_id=fa7546fad5fe40819971fb1808d51965, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.592486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb760-4081-4f0a-9ae2-52ce16718799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.592763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb760-4081-4f0a-9ae2-52ce16718799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.593035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb760-4081-4f0a-9ae2-52ce16718799 admin admin] PATH_INFO: `/v3/projects/fa9fbeccf9454848a6cb5c7859d6ff94/users/f0c58c62d7854ba8a112cb639e33717f/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.595097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba3b9e-1804-4518-bc6d-6231c9917a0f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.608683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 925/1848] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:21 2022] PUT /identity/v3/projects/941997f468fb4d8686d29911a0cd2f8f/users/fa7546fad5fe40819971fb1808d51965/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:21.608834 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdb760-4081-4f0a-9ae2-52ce16718799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9fbeccf9454848a6cb5c7859d6ff94, user_id=f0c58c62d7854ba8a112cb639e33717f, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.609559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba3b9e-1804-4518-bc6d-6231c9917a0f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.611401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdb760-4081-4f0a-9ae2-52ce16718799 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.628359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 924/1849] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:21 2022] PUT /identity/v3/projects/fa9fbeccf9454848a6cb5c7859d6ff94/users/f0c58c62d7854ba8a112cb639e33717f/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:21.629886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb760-4081-4f0a-9ae2-52ce16718799 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.675354 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba3b9e-1804-4518-bc6d-6231c9917a0f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.702816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb760-4081-4f0a-9ae2-52ce16718799 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.709576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e56a5-dcaf-4288-bac3-c28c5fec0985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.710129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e56a5-dcaf-4288-bac3-c28c5fec0985 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.710416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e56a5-dcaf-4288-bac3-c28c5fec0985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.710707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e56a5-dcaf-4288-bac3-c28c5fec0985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.711665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e56a5-dcaf-4288-bac3-c28c5fec0985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.713803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e56a5-dcaf-4288-bac3-c28c5fec0985 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.730744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 925/1850] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:21.730744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94800a-3438-40ca-b107-c11a236c49e6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.730744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94800a-3438-40ca-b107-c11a236c49e6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.731058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94800a-3438-40ca-b107-c11a236c49e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.743307 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8ab10-59bf-4982-8190-62c2a1d3cac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.744120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8ab10-59bf-4982-8190-62c2a1d3cac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.744575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8ab10-59bf-4982-8190-62c2a1d3cac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.745102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8ab10-59bf-4982-8190-62c2a1d3cac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.745960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8ab10-59bf-4982-8190-62c2a1d3cac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:21.746418 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8ab10-59bf-4982-8190-62c2a1d3cac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.748355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8ab10-59bf-4982-8190-62c2a1d3cac5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.766003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ca94800a-3438-40ca-b107-c11a236c49e6 None None] MFA Rules not processed for user `fa7546fad5fe40819971fb1808d51965`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:21.766278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 926/1851] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:21.768093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ca94800a-3438-40ca-b107-c11a236c49e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:21.768365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8ab10-59bf-4982-8190-62c2a1d3cac5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.785677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8ab10-59bf-4982-8190-62c2a1d3cac5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.792013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72af2d9-27cf-4fca-b43e-32c8be4df09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.792885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72af2d9-27cf-4fca-b43e-32c8be4df09f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.793353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72af2d9-27cf-4fca-b43e-32c8be4df09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.793821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72af2d9-27cf-4fca-b43e-32c8be4df09f admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.794646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72af2d9-27cf-4fca-b43e-32c8be4df09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.796755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72af2d9-27cf-4fca-b43e-32c8be4df09f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.809775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 927/1852] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:21.811122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72af2d9-27cf-4fca-b43e-32c8be4df09f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.823280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72af2d9-27cf-4fca-b43e-32c8be4df09f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.831097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce1073-b754-4a22-ae2f-5bbcea228cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.832119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce1073-b754-4a22-ae2f-5bbcea228cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.832730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce1073-b754-4a22-ae2f-5bbcea228cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.833207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce1073-b754-4a22-ae2f-5bbcea228cd7 admin admin] PATH_INFO: `/v3/projects/80c53f0d56e442739570dbc15156cce4/users/7931118ada9f40dbbc5a3c42c8a8c247/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.844376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:21.854332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce1073-b754-4a22-ae2f-5bbcea228cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c53f0d56e442739570dbc15156cce4, user_id=7931118ada9f40dbbc5a3c42c8a8c247, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:21.858947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce1073-b754-4a22-ae2f-5bbcea228cd7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:21.874030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 926/1853] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:21.875248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94800a-3438-40ca-b107-c11a236c49e6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.898462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 928/1854] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:21 2022] PUT /identity/v3/projects/80c53f0d56e442739570dbc15156cce4/users/7931118ada9f40dbbc5a3c42c8a8c247/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:21.898462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce1073-b754-4a22-ae2f-5bbcea228cd7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.907251 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94800a-3438-40ca-b107-c11a236c49e6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.965933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:21.995649 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce1073-b754-4a22-ae2f-5bbcea228cd7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.003499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9cfa6-0e0d-4fc2-8881-30743484aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.005932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9cfa6-0e0d-4fc2-8881-30743484aa9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.007824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9cfa6-0e0d-4fc2-8881-30743484aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.008869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9cfa6-0e0d-4fc2-8881-30743484aa9f admin admin] PATH_INFO: `/v3/projects/fa9fbeccf9454848a6cb5c7859d6ff94/users/f0c58c62d7854ba8a112cb639e33717f/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.013913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9cfa6-0e0d-4fc2-8881-30743484aa9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9fbeccf9454848a6cb5c7859d6ff94, user_id=f0c58c62d7854ba8a112cb639e33717f, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.018438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9cfa6-0e0d-4fc2-8881-30743484aa9f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.025711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c79ed7-894e-4e28-a83a-0a584172bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.027292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79ed7-894e-4e28-a83a-0a584172bc0e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.027588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79ed7-894e-4e28-a83a-0a584172bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.028210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79ed7-894e-4e28-a83a-0a584172bc0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.029235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c79ed7-894e-4e28-a83a-0a584172bc0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.031349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c79ed7-894e-4e28-a83a-0a584172bc0e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.041225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 929/1855] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:21 2022] PUT /identity/v3/projects/fa9fbeccf9454848a6cb5c7859d6ff94/users/f0c58c62d7854ba8a112cb639e33717f/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:22.043230 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9cfa6-0e0d-4fc2-8881-30743484aa9f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.082188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 927/1856] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:21 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:22.083988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d5d77-a887-475c-9e4c-c8aa8ca7d2d1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.084564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d5d77-a887-475c-9e4c-c8aa8ca7d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.084936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d5d77-a887-475c-9e4c-c8aa8ca7d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.122531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3d6d5d77-a887-475c-9e4c-c8aa8ca7d2d1 None None] MFA Rules not processed for user `7931118ada9f40dbbc5a3c42c8a8c247`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:22.124098 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3d6d5d77-a887-475c-9e4c-c8aa8ca7d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:22.180056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9cfa6-0e0d-4fc2-8881-30743484aa9f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.243096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 928/1857] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:22.245188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6877e-6e06-4999-8531-598d09ae8644 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.246162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6877e-6e06-4999-8531-598d09ae8644 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.246540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6877e-6e06-4999-8531-598d09ae8644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.280507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9ab6877e-6e06-4999-8531-598d09ae8644 None None] MFA Rules not processed for user `f0c58c62d7854ba8a112cb639e33717f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:22.282281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9ab6877e-6e06-4999-8531-598d09ae8644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:22.298365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88fb78-f9ce-4512-8c90-4af414c8a79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.299732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88fb78-f9ce-4512-8c90-4af414c8a79c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.300227 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88fb78-f9ce-4512-8c90-4af414c8a79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.300846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88fb78-f9ce-4512-8c90-4af414c8a79c admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.301690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88fb78-f9ce-4512-8c90-4af414c8a79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.303759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88fb78-f9ce-4512-8c90-4af414c8a79c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.343194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 930/1858] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:22 2022] POST /identity/v3/projects => generated 375 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:22.345604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88fb78-f9ce-4512-8c90-4af414c8a79c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.373922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:22.376429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 929/1859] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:22.378400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6877e-6e06-4999-8531-598d09ae8644 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.393211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6877e-6e06-4999-8531-598d09ae8644 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.439420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:22.476077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88fb78-f9ce-4512-8c90-4af414c8a79c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.482578 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833911f-dc10-47bc-8ead-030b8d9d97fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.483438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833911f-dc10-47bc-8ead-030b8d9d97fc admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.483714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833911f-dc10-47bc-8ead-030b8d9d97fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.484535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833911f-dc10-47bc-8ead-030b8d9d97fc admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.484654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833911f-dc10-47bc-8ead-030b8d9d97fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.486544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833911f-dc10-47bc-8ead-030b8d9d97fc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.488361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71913bb-fe21-4f7a-884f-194b86f6f62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.488984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71913bb-fe21-4f7a-884f-194b86f6f62b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.489849 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71913bb-fe21-4f7a-884f-194b86f6f62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.489849 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71913bb-fe21-4f7a-884f-194b86f6f62b admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.491763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71913bb-fe21-4f7a-884f-194b86f6f62b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.494802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71913bb-fe21-4f7a-884f-194b86f6f62b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.529431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 931/1860] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:22 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:22.530197 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833911f-dc10-47bc-8ead-030b8d9d97fc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.550256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 930/1861] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:22 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:22.550256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71913bb-fe21-4f7a-884f-194b86f6f62b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.550256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d71913bb-fe21-4f7a-884f-194b86f6f62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:22.552389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833911f-dc10-47bc-8ead-030b8d9d97fc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.636456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71913bb-fe21-4f7a-884f-194b86f6f62b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.640945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13983c-9f7d-46ff-91bc-cd9053ec8c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.641546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13983c-9f7d-46ff-91bc-cd9053ec8c17 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.641803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13983c-9f7d-46ff-91bc-cd9053ec8c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.642088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13983c-9f7d-46ff-91bc-cd9053ec8c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.645593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2b13983c-9f7d-46ff-91bc-cd9053ec8c17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:22.663830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bb816-7686-4df0-b5f3-75277876fadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.664454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb816-7686-4df0-b5f3-75277876fadf admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.664741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb816-7686-4df0-b5f3-75277876fadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.665013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb816-7686-4df0-b5f3-75277876fadf admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.667033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bb816-7686-4df0-b5f3-75277876fadf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.669198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bb816-7686-4df0-b5f3-75277876fadf admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.700312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 932/1862] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:22 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:22.700312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bb816-7686-4df0-b5f3-75277876fadf admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.711269 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bb816-7686-4df0-b5f3-75277876fadf admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.721722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a8529-767a-465c-9db8-b7609a467a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.722358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a8529-767a-465c-9db8-b7609a467a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.722640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a8529-767a-465c-9db8-b7609a467a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.723125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a8529-767a-465c-9db8-b7609a467a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.723822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a8529-767a-465c-9db8-b7609a467a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.726363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a8529-767a-465c-9db8-b7609a467a93 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.726903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13983c-9f7d-46ff-91bc-cd9053ec8c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.729892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13983c-9f7d-46ff-91bc-cd9053ec8c17 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.739166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 933/1863] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:22.740707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 931/1864] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:22.744033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13983c-9f7d-46ff-91bc-cd9053ec8c17 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.744192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a8529-767a-465c-9db8-b7609a467a93 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.756902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a8529-767a-465c-9db8-b7609a467a93 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.762362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a2427-33b0-4725-a1bf-2b640c079df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.763143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a2427-33b0-4725-a1bf-2b640c079df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.763424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a2427-33b0-4725-a1bf-2b640c079df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.763711 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a2427-33b0-4725-a1bf-2b640c079df8 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.763980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13983c-9f7d-46ff-91bc-cd9053ec8c17 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.764334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a2427-33b0-4725-a1bf-2b640c079df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.766340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a2427-33b0-4725-a1bf-2b640c079df8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.769215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4e00f-02af-4895-8efe-7c70a638153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.769923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e00f-02af-4895-8efe-7c70a638153f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.770273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e00f-02af-4895-8efe-7c70a638153f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.770814 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e00f-02af-4895-8efe-7c70a638153f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.771533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4e00f-02af-4895-8efe-7c70a638153f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.773525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4e00f-02af-4895-8efe-7c70a638153f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.812543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 932/1865] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:22.812543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4e00f-02af-4895-8efe-7c70a638153f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.827359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 934/1866] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:22 2022] POST /identity/v3/users => generated 299 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:22.828493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a2427-33b0-4725-a1bf-2b640c079df8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.842806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4e00f-02af-4895-8efe-7c70a638153f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.846048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a2427-33b0-4725-a1bf-2b640c079df8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.862417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a8f4-62d6-4ab3-a93f-ba92733e2de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.865078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a8f4-62d6-4ab3-a93f-ba92733e2de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.866793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a8f4-62d6-4ab3-a93f-ba92733e2de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.867084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a8f4-62d6-4ab3-a93f-ba92733e2de7 admin admin] PATH_INFO: `/v3/projects/0d229498f2964541a96a7a9ecadfeae2/users/19e9e295c4f54106a787e87481ad664e/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.878656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767039b0-7d88-4746-b0dd-be1d8bfdc07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.879918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767039b0-7d88-4746-b0dd-be1d8bfdc07d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.879918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767039b0-7d88-4746-b0dd-be1d8bfdc07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.880131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767039b0-7d88-4746-b0dd-be1d8bfdc07d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.880755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767039b0-7d88-4746-b0dd-be1d8bfdc07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.882414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767039b0-7d88-4746-b0dd-be1d8bfdc07d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.912671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7a8f4-62d6-4ab3-a93f-ba92733e2de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d229498f2964541a96a7a9ecadfeae2, user_id=19e9e295c4f54106a787e87481ad664e, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.923313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 933/1867] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:22.924377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767039b0-7d88-4746-b0dd-be1d8bfdc07d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.935803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7a8f4-62d6-4ab3-a93f-ba92733e2de7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.960259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767039b0-7d88-4746-b0dd-be1d8bfdc07d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.966848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c826cb-d405-4cbb-a40d-22e86f552e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.967357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c826cb-d405-4cbb-a40d-22e86f552e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.967632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c826cb-d405-4cbb-a40d-22e86f552e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.967905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c826cb-d405-4cbb-a40d-22e86f552e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.968722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c826cb-d405-4cbb-a40d-22e86f552e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.970413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c826cb-d405-4cbb-a40d-22e86f552e02 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.988724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 934/1869] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:22.988724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c826cb-d405-4cbb-a40d-22e86f552e02 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.994510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 935/1869] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:22 2022] PUT /identity/v3/projects/0d229498f2964541a96a7a9ecadfeae2/users/19e9e295c4f54106a787e87481ad664e/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:22.996024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a8f4-62d6-4ab3-a93f-ba92733e2de7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.999533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c826cb-d405-4cbb-a40d-22e86f552e02 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:23.094531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:23.141446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:23.179570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78422f0-8af0-4b0d-a0ce-1c1a238962ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:23.180263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78422f0-8af0-4b0d-a0ce-1c1a238962ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.180554 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78422f0-8af0-4b0d-a0ce-1c1a238962ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.181368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78422f0-8af0-4b0d-a0ce-1c1a238962ef admin admin] PATH_INFO: `/v3/projects/14aa435066144942a415086246ab6847/users/7c56d34c1bb34cfbaa97e161efbb30c1/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.198146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a8f4-62d6-4ab3-a93f-ba92733e2de7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:23.224705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c34d0-05ad-436d-a50d-2e6ce17e29dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:23.229804 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c34d0-05ad-436d-a50d-2e6ce17e29dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.230119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c34d0-05ad-436d-a50d-2e6ce17e29dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.230373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c34d0-05ad-436d-a50d-2e6ce17e29dc admin admin] PATH_INFO: `/v3/projects/d3a825ac0dde4486aa85bb3761abef91/users/8d0a1d452e8545ee9423ff48526231b0/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.241589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78422f0-8af0-4b0d-a0ce-1c1a238962ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=14aa435066144942a415086246ab6847, user_id=7c56d34c1bb34cfbaa97e161efbb30c1, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:23.251982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78422f0-8af0-4b0d-a0ce-1c1a238962ef admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:23.276431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c34d0-05ad-436d-a50d-2e6ce17e29dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a825ac0dde4486aa85bb3761abef91, user_id=8d0a1d452e8545ee9423ff48526231b0, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:23.279449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c34d0-05ad-436d-a50d-2e6ce17e29dc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:23.289557 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 935/1870] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:22 2022] PUT /identity/v3/projects/14aa435066144942a415086246ab6847/users/7c56d34c1bb34cfbaa97e161efbb30c1/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:23.291063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78422f0-8af0-4b0d-a0ce-1c1a238962ef admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:23.311965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 936/1871] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:22 2022] PUT /identity/v3/projects/d3a825ac0dde4486aa85bb3761abef91/users/8d0a1d452e8545ee9423ff48526231b0/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:23.316288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29030-1f69-41a1-9d6f-40b5d4fe8c54 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.316578 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29030-1f69-41a1-9d6f-40b5d4fe8c54 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.316864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29030-1f69-41a1-9d6f-40b5d4fe8c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.398448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ebb29030-1f69-41a1-9d6f-40b5d4fe8c54 None None] MFA Rules not processed for user `7c56d34c1bb34cfbaa97e161efbb30c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:23.402372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ebb29030-1f69-41a1-9d6f-40b5d4fe8c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:23.420072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78422f0-8af0-4b0d-a0ce-1c1a238962ef admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:23.531293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 937/1872] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:23.532481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29030-1f69-41a1-9d6f-40b5d4fe8c54 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:23.548477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b74387-c5f4-4fc0-93d4-417427569213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:23.549488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74387-c5f4-4fc0-93d4-417427569213 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.549724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74387-c5f4-4fc0-93d4-417427569213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.550004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74387-c5f4-4fc0-93d4-417427569213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.550728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b74387-c5f4-4fc0-93d4-417427569213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:23.552999 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b74387-c5f4-4fc0-93d4-417427569213 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:23.573136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 936/1873] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:23.573136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b74387-c5f4-4fc0-93d4-417427569213 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:23.643554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29030-1f69-41a1-9d6f-40b5d4fe8c54 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:23.648440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b74387-c5f4-4fc0-93d4-417427569213 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:23.650652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596aa1c-8139-4db1-8d7a-af63bf0eeafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:23.651317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596aa1c-8139-4db1-8d7a-af63bf0eeafc admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.651610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596aa1c-8139-4db1-8d7a-af63bf0eeafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.651936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596aa1c-8139-4db1-8d7a-af63bf0eeafc admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.652596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596aa1c-8139-4db1-8d7a-af63bf0eeafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:23.655034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596aa1c-8139-4db1-8d7a-af63bf0eeafc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:23.655730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27552df5-64c4-46c5-bcee-4bee9afd0545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:23.656231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27552df5-64c4-46c5-bcee-4bee9afd0545 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.656753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27552df5-64c4-46c5-bcee-4bee9afd0545 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.657218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27552df5-64c4-46c5-bcee-4bee9afd0545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.668090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 938/1874] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:23.669025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596aa1c-8139-4db1-8d7a-af63bf0eeafc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:23.669504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27552df5-64c4-46c5-bcee-4bee9afd0545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:23.671211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27552df5-64c4-46c5-bcee-4bee9afd0545 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:23.686449 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 937/1875] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:23.687698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27552df5-64c4-46c5-bcee-4bee9afd0545 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:23.703107 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596aa1c-8139-4db1-8d7a-af63bf0eeafc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:23.704121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27552df5-64c4-46c5-bcee-4bee9afd0545 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:23.711436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754a339-3317-4ef6-a0a7-cc03361814ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:23.712663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754a339-3317-4ef6-a0a7-cc03361814ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.713526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754a339-3317-4ef6-a0a7-cc03361814ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.714185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754a339-3317-4ef6-a0a7-cc03361814ce admin admin] PATH_INFO: `/v3/projects/d3a825ac0dde4486aa85bb3761abef91/users/8d0a1d452e8545ee9423ff48526231b0/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.717030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754a339-3317-4ef6-a0a7-cc03361814ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a825ac0dde4486aa85bb3761abef91, user_id=8d0a1d452e8545ee9423ff48526231b0, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:23.717225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4526c2f-df42-4b30-8743-4c94550d72cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:23.719304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4526c2f-df42-4b30-8743-4c94550d72cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.721019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754a339-3317-4ef6-a0a7-cc03361814ce admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:23.721429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4526c2f-df42-4b30-8743-4c94550d72cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.721961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4526c2f-df42-4b30-8743-4c94550d72cd admin admin] PATH_INFO: `/v3/projects/0d229498f2964541a96a7a9ecadfeae2/users/19e9e295c4f54106a787e87481ad664e/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.724583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:23.729335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4526c2f-df42-4b30-8743-4c94550d72cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d229498f2964541a96a7a9ecadfeae2, user_id=19e9e295c4f54106a787e87481ad664e, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:23.737006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4526c2f-df42-4b30-8743-4c94550d72cd admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:23.738057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 938/1876] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:23 2022] PUT /identity/v3/projects/d3a825ac0dde4486aa85bb3761abef91/users/8d0a1d452e8545ee9423ff48526231b0/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:23.751127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b411e-d1dc-475c-b8b2-ead608f1dca3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.751706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b411e-d1dc-475c-b8b2-ead608f1dca3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.752307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b411e-d1dc-475c-b8b2-ead608f1dca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.778702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 939/1877] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:23 2022] PUT /identity/v3/projects/0d229498f2964541a96a7a9ecadfeae2/users/19e9e295c4f54106a787e87481ad664e/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:23.785713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8f254-b5e8-4c79-a906-164e8802471b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.785713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8f254-b5e8-4c79-a906-164e8802471b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.785713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8f254-b5e8-4c79-a906-164e8802471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.823151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ea9b411e-d1dc-475c-b8b2-ead608f1dca3 None None] MFA Rules not processed for user `8d0a1d452e8545ee9423ff48526231b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:23.824952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea9b411e-d1dc-475c-b8b2-ead608f1dca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:23.855069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-02c8f254-b5e8-4c79-a906-164e8802471b None None] MFA Rules not processed for user `19e9e295c4f54106a787e87481ad664e`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:23.856304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-02c8f254-b5e8-4c79-a906-164e8802471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:23.918871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:23.925667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 939/1878] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:23.937495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b411e-d1dc-475c-b8b2-ead608f1dca3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:23.939405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea9b411e-d1dc-475c-b8b2-ead608f1dca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:24.017660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 940/1879] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:24.038577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b411e-d1dc-475c-b8b2-ead608f1dca3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:24.045054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9c417-6792-4d18-b9ce-d27846dd927e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:24.045434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9c417-6792-4d18-b9ce-d27846dd927e service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:24.046131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9c417-6792-4d18-b9ce-d27846dd927e service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:24.046534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9c417-6792-4d18-b9ce-d27846dd927e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:24.157410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9c417-6792-4d18-b9ce-d27846dd927e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:24.159475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9c417-6792-4d18-b9ce-d27846dd927e service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:24.192649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 940/1880] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:24.277371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8f254-b5e8-4c79-a906-164e8802471b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:24.290542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8f254-b5e8-4c79-a906-164e8802471b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:24.294561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cd957-b54d-4e0f-98f3-23a7a39d013d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:24.295480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cd957-b54d-4e0f-98f3-23a7a39d013d service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:24.295911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cd957-b54d-4e0f-98f3-23a7a39d013d service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:24.296194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cd957-b54d-4e0f-98f3-23a7a39d013d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:24.421638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cd957-b54d-4e0f-98f3-23a7a39d013d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:24.423856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cd957-b54d-4e0f-98f3-23a7a39d013d service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:24.438737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 941/1881] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:24.957659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9c417-6792-4d18-b9ce-d27846dd927e service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:24.975579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9c417-6792-4d18-b9ce-d27846dd927e service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:24.978614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81face5a-4413-405c-8629-b996ad8320f3 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:24.981557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81face5a-4413-405c-8629-b996ad8320f3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:24.981557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81face5a-4413-405c-8629-b996ad8320f3 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:24.983612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 942/1882] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:35:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:24.990036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2eb5e-0b2f-410c-8713-0df282234e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:24.990815 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2eb5e-0b2f-410c-8713-0df282234e2c service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:24.991103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2eb5e-0b2f-410c-8713-0df282234e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:24.991396 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2eb5e-0b2f-410c-8713-0df282234e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:25.027953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eece0-0e17-4662-832c-f58117edf7d4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:25.028484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eece0-0e17-4662-832c-f58117edf7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:25.028922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eece0-0e17-4662-832c-f58117edf7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:25.088461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bb1eece0-0e17-4662-832c-f58117edf7d4 None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:25.089716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bb1eece0-0e17-4662-832c-f58117edf7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:25.096748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:25.169174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2eb5e-0b2f-410c-8713-0df282234e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:25.173524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2eb5e-0b2f-410c-8713-0df282234e2c service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:25.201930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 941/1883] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:25.280209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 943/1884] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:35:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:25.308210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2eb5e-0b2f-410c-8713-0df282234e2c service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:25.309720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-77b2eb5e-0b2f-410c-8713-0df282234e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:25.345013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2eb5e-0b2f-410c-8713-0df282234e2c service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:25.366494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638ce15-ee7d-4418-854a-4c993e364fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:25.367153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638ce15-ee7d-4418-854a-4c993e364fc4 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:25.367734 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638ce15-ee7d-4418-854a-4c993e364fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:25.370081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638ce15-ee7d-4418-854a-4c993e364fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:25.400773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638ce15-ee7d-4418-854a-4c993e364fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:25.402858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638ce15-ee7d-4418-854a-4c993e364fc4 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:25.425967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 942/1885] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:27.792033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eece0-0e17-4662-832c-f58117edf7d4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:27.887244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:27.906979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eece0-0e17-4662-832c-f58117edf7d4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:27.915264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:27.916969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:27.917820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:27.919225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] PATH_INFO: `/v3/users/fa7546fad5fe40819971fb1808d51965` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:27.921314 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7546fad5fe40819971fb1808d51965)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:27.923765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:27.981388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7546fad5fe40819971fb1808d51965'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:27.982245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7546fad5fe40819971fb1808d51965'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:27.996108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7546fad5fe40819971fb1808d51965'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.003196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7546fad5fe40819971fb1808d51965'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.004075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7546fad5fe40819971fb1808d51965'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.018480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 944/1886] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:27 2022] DELETE /identity/v3/users/fa7546fad5fe40819971fb1808d51965 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:28.023178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1a17f-4911-4323-85e5-bf72dc73f7fe None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:28.023634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1a17f-4911-4323-85e5-bf72dc73f7fe None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:28.023916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1a17f-4911-4323-85e5-bf72dc73f7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:28.045398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-94e1a17f-4911-4323-85e5-bf72dc73f7fe None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:28.047152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-94e1a17f-4911-4323-85e5-bf72dc73f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:28.127080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 943/1887] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:28.160084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:28.161551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:28.236515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e412e7-d47c-44bf-97e0-6cdda2c5f050 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:28.241082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49f3c-e8b5-4532-9358-ff10bdbdd6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:28.241814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49f3c-e8b5-4532-9358-ff10bdbdd6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:28.242340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49f3c-e8b5-4532-9358-ff10bdbdd6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:28.243061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49f3c-e8b5-4532-9358-ff10bdbdd6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:28.255555 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b49f3c-e8b5-4532-9358-ff10bdbdd6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:28.257315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b49f3c-e8b5-4532-9358-ff10bdbdd6e3 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:28.269948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 945/1888] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:28.644803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1a17f-4911-4323-85e5-bf72dc73f7fe None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:28.647283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-94e1a17f-4911-4323-85e5-bf72dc73f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:28.668213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1a17f-4911-4323-85e5-bf72dc73f7fe None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:28.682522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:28.686008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:28.686661 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:28.687382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] PATH_INFO: `/v3/projects/941997f468fb4d8686d29911a0cd2f8f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:28.689832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=941997f468fb4d8686d29911a0cd2f8f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:28.692954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:28.751644 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941997f468fb4d8686d29911a0cd2f8f', 'request_id': 'req-9ea79342-0570-4a8b-92d2-676d78cf33fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.757216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941997f468fb4d8686d29911a0cd2f8f', 'request_id': 'req-9ea79342-0570-4a8b-92d2-676d78cf33fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.765927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941997f468fb4d8686d29911a0cd2f8f', 'request_id': 'req-9ea79342-0570-4a8b-92d2-676d78cf33fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.779520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] The token cache is being invalidate because project 941997f468fb4d8686d29911a0cd2f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:28.779812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.780433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.781921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 944/1889] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:28 2022] DELETE /identity/v3/projects/941997f468fb4d8686d29911a0cd2f8f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:28.786215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49f3c-e8b5-4532-9358-ff10bdbdd6e3 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:28.796621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49f3c-e8b5-4532-9358-ff10bdbdd6e3 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:28.865193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:28.865959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:28.866099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:28.866369 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] PATH_INFO: `/v3/users/19e9e295c4f54106a787e87481ad664e` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:28.867597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e9e295c4f54106a787e87481ad664e)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:28.870144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:28.883722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:28.920170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:28.921609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:28.922905 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e9e295c4f54106a787e87481ad664e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.923544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e9e295c4f54106a787e87481ad664e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.936470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e9e295c4f54106a787e87481ad664e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.944381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e9e295c4f54106a787e87481ad664e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.945311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e9e295c4f54106a787e87481ad664e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:28.959873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 946/1890] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:28 2022] DELETE /identity/v3/users/19e9e295c4f54106a787e87481ad664e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:28.969307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:28.990434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea79342-0570-4a8b-92d2-676d78cf33fa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:29.059023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35253a7-acb3-4e5b-a6eb-361e812963a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:29.060415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35253a7-acb3-4e5b-a6eb-361e812963a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.060920 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35253a7-acb3-4e5b-a6eb-361e812963a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.061292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35253a7-acb3-4e5b-a6eb-361e812963a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.063397 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c35253a7-acb3-4e5b-a6eb-361e812963a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:29.134843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35253a7-acb3-4e5b-a6eb-361e812963a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:29.136293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35253a7-acb3-4e5b-a6eb-361e812963a5 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:29.146198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 945/1891] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:29.271786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:29.273254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:29.357190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba84b72-57b8-4e7a-a5ed-54d8693e5098 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:29.363961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:29.364661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.365001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.365335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] PATH_INFO: `/v3/projects/0d229498f2964541a96a7a9ecadfeae2` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.366641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d229498f2964541a96a7a9ecadfeae2)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:29.370573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:29.409746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35253a7-acb3-4e5b-a6eb-361e812963a5 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:29.411406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c35253a7-acb3-4e5b-a6eb-361e812963a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:29.437669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35253a7-acb3-4e5b-a6eb-361e812963a5 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:29.481243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d229498f2964541a96a7a9ecadfeae2', 'request_id': 'req-68099272-469d-4c13-9bc7-818768fae91f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.488315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d229498f2964541a96a7a9ecadfeae2', 'request_id': 'req-68099272-469d-4c13-9bc7-818768fae91f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.495219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d229498f2964541a96a7a9ecadfeae2', 'request_id': 'req-68099272-469d-4c13-9bc7-818768fae91f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.528642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] The token cache is being invalidate because project 0d229498f2964541a96a7a9ecadfeae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:29.529125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.531364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-68099272-469d-4c13-9bc7-818768fae91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.541573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 947/1892] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:29 2022] DELETE /identity/v3/projects/0d229498f2964541a96a7a9ecadfeae2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:29.543560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc922-2785-4cb0-ab61-afdb7d9f7ed9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.544003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc922-2785-4cb0-ab61-afdb7d9f7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.544431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc922-2785-4cb0-ab61-afdb7d9f7ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.569167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b3ddc922-2785-4cb0-ab61-afdb7d9f7ed9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:29.570827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b3ddc922-2785-4cb0-ab61-afdb7d9f7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:29.594319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:29.628930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:29.629573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.629859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.630132 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] PATH_INFO: `/v3/users/82aa6039a5254c628e6a0bac01f676fc` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.631645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82aa6039a5254c628e6a0bac01f676fc)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:29.634955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:29.678343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 948/1893] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:29.679525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc922-2785-4cb0-ab61-afdb7d9f7ed9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:29.682526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b3ddc922-2785-4cb0-ab61-afdb7d9f7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:29.701129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc922-2785-4cb0-ab61-afdb7d9f7ed9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:29.712874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:29.719520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.719992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.720431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] PATH_INFO: `/v3/users/7c56d34c1bb34cfbaa97e161efbb30c1` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.722114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c56d34c1bb34cfbaa97e161efbb30c1)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:29.722591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:29.725088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:29.726263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82aa6039a5254c628e6a0bac01f676fc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.728076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82aa6039a5254c628e6a0bac01f676fc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.741211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82aa6039a5254c628e6a0bac01f676fc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.742597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82aa6039a5254c628e6a0bac01f676fc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.764292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3fcd5429-95bb-4c72-95b3-77b41ed16297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82aa6039a5254c628e6a0bac01f676fc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.786337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 946/1894] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:29 2022] DELETE /identity/v3/users/82aa6039a5254c628e6a0bac01f676fc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:29.793460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe26b10-74d0-4080-8274-3c84d50b09aa None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.794292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe26b10-74d0-4080-8274-3c84d50b09aa None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.794879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe26b10-74d0-4080-8274-3c84d50b09aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.807278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c56d34c1bb34cfbaa97e161efbb30c1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.808136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c56d34c1bb34cfbaa97e161efbb30c1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.815646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6fe26b10-74d0-4080-8274-3c84d50b09aa None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:29.816872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6fe26b10-74d0-4080-8274-3c84d50b09aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:29.827590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c56d34c1bb34cfbaa97e161efbb30c1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.838238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c56d34c1bb34cfbaa97e161efbb30c1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.838999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9de403ed-84d2-4d57-8485-92c9f41ea14a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c56d34c1bb34cfbaa97e161efbb30c1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:29.855093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 949/1895] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:29 2022] DELETE /identity/v3/users/7c56d34c1bb34cfbaa97e161efbb30c1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:29.856127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bfdf-d624-4df4-a3bd-4ce9090440d2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.856411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bfdf-d624-4df4-a3bd-4ce9090440d2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.856688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bfdf-d624-4df4-a3bd-4ce9090440d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.879987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8111bfdf-d624-4df4-a3bd-4ce9090440d2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:29.881350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8111bfdf-d624-4df4-a3bd-4ce9090440d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:29.898659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 947/1896] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:29.900789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479955-4e2e-4dc1-b1e1-3f8efa0cc42b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.901073 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479955-4e2e-4dc1-b1e1-3f8efa0cc42b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.901352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479955-4e2e-4dc1-b1e1-3f8efa0cc42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.929816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bb479955-4e2e-4dc1-b1e1-3f8efa0cc42b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:29.931839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bb479955-4e2e-4dc1-b1e1-3f8efa0cc42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:29.965022 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 950/1897] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:29.966205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bfdf-d624-4df4-a3bd-4ce9090440d2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:29.978162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bfdf-d624-4df4-a3bd-4ce9090440d2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:29.991292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61424828-92d1-408a-91b2-6dc3e79c9c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:29.991978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61424828-92d1-408a-91b2-6dc3e79c9c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.992317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61424828-92d1-408a-91b2-6dc3e79c9c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.992630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61424828-92d1-408a-91b2-6dc3e79c9c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.994475 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61424828-92d1-408a-91b2-6dc3e79c9c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:29.994825 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61424828-92d1-408a-91b2-6dc3e79c9c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:29.996935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61424828-92d1-408a-91b2-6dc3e79c9c0e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:30.021968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 948/1898] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:30.022952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479955-4e2e-4dc1-b1e1-3f8efa0cc42b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:30.024952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bb479955-4e2e-4dc1-b1e1-3f8efa0cc42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:30.040422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 951/1899] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:30.040422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61424828-92d1-408a-91b2-6dc3e79c9c0e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:30.047099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-61424828-92d1-408a-91b2-6dc3e79c9c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:30.077174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:30.089334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479955-4e2e-4dc1-b1e1-3f8efa0cc42b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:30.092960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17b6a-1ffc-486c-8e85-592969407c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:30.093565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17b6a-1ffc-486c-8e85-592969407c1d service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:30.093840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17b6a-1ffc-486c-8e85-592969407c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:30.094108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17b6a-1ffc-486c-8e85-592969407c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:30.103196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b17b6a-1ffc-486c-8e85-592969407c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:30.104711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b17b6a-1ffc-486c-8e85-592969407c1d service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:30.111582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61424828-92d1-408a-91b2-6dc3e79c9c0e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:30.114468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 949/1900] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:30.115284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17b6a-1ffc-486c-8e85-592969407c1d service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:30.115396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11128559-d1cd-4a7c-847d-2365d79b93df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:30.115968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128559-d1cd-4a7c-847d-2365d79b93df service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:30.116245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128559-d1cd-4a7c-847d-2365d79b93df service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:30.116514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128559-d1cd-4a7c-847d-2365d79b93df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:30.125636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17b6a-1ffc-486c-8e85-592969407c1d service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:30.126067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11128559-d1cd-4a7c-847d-2365d79b93df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:30.127593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11128559-d1cd-4a7c-847d-2365d79b93df service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:30.132047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807264c-3b53-4c8d-9c3a-9a1428715845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:30.132787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807264c-3b53-4c8d-9c3a-9a1428715845 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:30.133281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807264c-3b53-4c8d-9c3a-9a1428715845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:30.134280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807264c-3b53-4c8d-9c3a-9a1428715845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:30.135232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807264c-3b53-4c8d-9c3a-9a1428715845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:30.137380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807264c-3b53-4c8d-9c3a-9a1428715845 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:30.138168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 952/1901] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:30.142488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:30.169861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 950/1902] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:30 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:30.174183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11128559-d1cd-4a7c-847d-2365d79b93df service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:30.185001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11128559-d1cd-4a7c-847d-2365d79b93df service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:30.250883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2defe05-629a-47bb-9d99-938f7182d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:30.251772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2defe05-629a-47bb-9d99-938f7182d430 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:30.252206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2defe05-629a-47bb-9d99-938f7182d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:30.252598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2defe05-629a-47bb-9d99-938f7182d430 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:30.253611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2defe05-629a-47bb-9d99-938f7182d430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:30.256989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2defe05-629a-47bb-9d99-938f7182d430 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:30.295636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 953/1903] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:30 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:30.297110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807264c-3b53-4c8d-9c3a-9a1428715845 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:30.310261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807264c-3b53-4c8d-9c3a-9a1428715845 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:30.314932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261512a-ad16-4d08-a0b1-ce9b2ab4e32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:30.315542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261512a-ad16-4d08-a0b1-ce9b2ab4e32d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:30.315813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261512a-ad16-4d08-a0b1-ce9b2ab4e32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:30.316084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261512a-ad16-4d08-a0b1-ce9b2ab4e32d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:30.316720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261512a-ad16-4d08-a0b1-ce9b2ab4e32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:30.318317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261512a-ad16-4d08-a0b1-ce9b2ab4e32d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:30.332071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 951/1904] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:30.333541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2defe05-629a-47bb-9d99-938f7182d430 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:30.354063 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2defe05-629a-47bb-9d99-938f7182d430 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:30.365407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89461619-e541-4796-bb92-8563a9ba07a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:30.366106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461619-e541-4796-bb92-8563a9ba07a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:30.366853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461619-e541-4796-bb92-8563a9ba07a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:30.366853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461619-e541-4796-bb92-8563a9ba07a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:30.368225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89461619-e541-4796-bb92-8563a9ba07a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:30.369856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89461619-e541-4796-bb92-8563a9ba07a3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:30.382256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 954/1905] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:30.393128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261512a-ad16-4d08-a0b1-ce9b2ab4e32d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:30.405510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261512a-ad16-4d08-a0b1-ce9b2ab4e32d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:30.421898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5b650-a7f8-4444-842d-95a3a563ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:30.422721 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5b650-a7f8-4444-842d-95a3a563ae2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:30.423342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5b650-a7f8-4444-842d-95a3a563ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:30.423613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5b650-a7f8-4444-842d-95a3a563ae2d admin admin] PATH_INFO: `/v3/projects/857a9bd4987b4dfea95341dab96afb53/users/3bb28460d1a14e24b6567b937e2640d5/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:30.447463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5b650-a7f8-4444-842d-95a3a563ae2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=857a9bd4987b4dfea95341dab96afb53, user_id=3bb28460d1a14e24b6567b937e2640d5, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:30.452152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5b650-a7f8-4444-842d-95a3a563ae2d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:30.477325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 952/1906] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:30 2022] PUT /identity/v3/projects/857a9bd4987b4dfea95341dab96afb53/users/3bb28460d1a14e24b6567b937e2640d5/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:30.487085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e09f4-a938-418d-895f-df90ee3643da None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:30.487428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e09f4-a938-418d-895f-df90ee3643da None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:30.487744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e09f4-a938-418d-895f-df90ee3643da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:30.530957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-764e09f4-a938-418d-895f-df90ee3643da None None] MFA Rules not processed for user `3bb28460d1a14e24b6567b937e2640d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:30.532195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-764e09f4-a938-418d-895f-df90ee3643da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:30.659659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5b650-a7f8-4444-842d-95a3a563ae2d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:30.663218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d0f5b650-a7f8-4444-842d-95a3a563ae2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:30.681849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 955/1907] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:30.688247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e09f4-a938-418d-895f-df90ee3643da None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:30.697035 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-764e09f4-a938-418d-895f-df90ee3643da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:30.811385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:30.835790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5b650-a7f8-4444-842d-95a3a563ae2d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:30.853612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:30.854524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:30.855183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:30.855673 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] PATH_INFO: `/v3/projects/9d2e753b77a24af79d0ba81b3663f531` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:30.859996 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2e753b77a24af79d0ba81b3663f531)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:30.862060 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:30.906331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e09f4-a938-418d-895f-df90ee3643da None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:30.916771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:30.917425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:30.917712 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:30.917986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] PATH_INFO: `/v3/projects/14aa435066144942a415086246ab6847` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:30.919477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=14aa435066144942a415086246ab6847)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:30.922499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:31.020654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2e753b77a24af79d0ba81b3663f531', 'request_id': 'req-19d180e9-fc83-4927-8b80-10e5e85e2d7f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.038010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14aa435066144942a415086246ab6847', 'request_id': 'req-40b3e61c-042d-4fbc-8f79-6734e178b1dd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.051332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2e753b77a24af79d0ba81b3663f531', 'request_id': 'req-19d180e9-fc83-4927-8b80-10e5e85e2d7f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.061026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14aa435066144942a415086246ab6847', 'request_id': 'req-40b3e61c-042d-4fbc-8f79-6734e178b1dd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.064515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2e753b77a24af79d0ba81b3663f531', 'request_id': 'req-19d180e9-fc83-4927-8b80-10e5e85e2d7f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.070141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14aa435066144942a415086246ab6847', 'request_id': 'req-40b3e61c-042d-4fbc-8f79-6734e178b1dd'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.091677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] The token cache is being invalidate because project 9d2e753b77a24af79d0ba81b3663f531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:31.091677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.092358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.094586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] The token cache is being invalidate because project 14aa435066144942a415086246ab6847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:31.094908 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.095766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 953/1908] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:30 2022] DELETE /identity/v3/projects/9d2e753b77a24af79d0ba81b3663f531 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:31.096011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.097651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 956/1909] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:30 2022] DELETE /identity/v3/projects/14aa435066144942a415086246ab6847 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:31.102866 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:31.103060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:31.103164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:31.103254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:31.184827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3e61c-042d-4fbc-8f79-6734e178b1dd admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:31.190311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:31.191495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.191877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.192436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] PATH_INFO: `/v3/users/f0c58c62d7854ba8a112cb639e33717f` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.195062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c58c62d7854ba8a112cb639e33717f)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:31.198095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:31.230894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:31.293784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c58c62d7854ba8a112cb639e33717f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.296070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c58c62d7854ba8a112cb639e33717f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.299857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d180e9-fc83-4927-8b80-10e5e85e2d7f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:31.324817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70554f5a-c3a8-4dd7-a7d4-d2b3743906e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:31.325992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70554f5a-c3a8-4dd7-a7d4-d2b3743906e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.326398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70554f5a-c3a8-4dd7-a7d4-d2b3743906e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.326836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70554f5a-c3a8-4dd7-a7d4-d2b3743906e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.327623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70554f5a-c3a8-4dd7-a7d4-d2b3743906e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:31.330245 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70554f5a-c3a8-4dd7-a7d4-d2b3743906e7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:31.341659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c58c62d7854ba8a112cb639e33717f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.343192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:31.378398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c58c62d7854ba8a112cb639e33717f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.381545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c58c62d7854ba8a112cb639e33717f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:31.382648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 954/1910] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:31 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:31.387534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875d04c-0f04-4ebd-bd31-2ba8135c8f64 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.388035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875d04c-0f04-4ebd-bd31-2ba8135c8f64 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.388534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875d04c-0f04-4ebd-bd31-2ba8135c8f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.424161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 957/1911] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:31 2022] DELETE /identity/v3/users/f0c58c62d7854ba8a112cb639e33717f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:31.425103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:31.434704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4875d04c-0f04-4ebd-bd31-2ba8135c8f64 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:31.435355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:31.441086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4875d04c-0f04-4ebd-bd31-2ba8135c8f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:31.562881 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fe745-31b5-4e75-8268-50d4addc9ae0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:31.570894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa558deb-ad21-4ea0-8b38-03c7b48b66c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:31.571571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa558deb-ad21-4ea0-8b38-03c7b48b66c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.571856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa558deb-ad21-4ea0-8b38-03c7b48b66c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.572127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa558deb-ad21-4ea0-8b38-03c7b48b66c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.572832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa558deb-ad21-4ea0-8b38-03c7b48b66c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:31.574963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa558deb-ad21-4ea0-8b38-03c7b48b66c4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:31.606860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 958/1912] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:31 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:31.611111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa558deb-ad21-4ea0-8b38-03c7b48b66c4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:31.627230 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa558deb-ad21-4ea0-8b38-03c7b48b66c4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:31.634783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85734ff-638a-45c4-94d5-99ba69903af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:31.635786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85734ff-638a-45c4-94d5-99ba69903af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.636000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85734ff-638a-45c4-94d5-99ba69903af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.636434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85734ff-638a-45c4-94d5-99ba69903af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.637282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85734ff-638a-45c4-94d5-99ba69903af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:31.639629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85734ff-638a-45c4-94d5-99ba69903af2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:31.661454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 959/1913] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:31.666659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85734ff-638a-45c4-94d5-99ba69903af2 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:31.671378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 955/1914] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:31.679337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8a2c4-7282-4029-a66c-d79190ef9e84 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.679677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8a2c4-7282-4029-a66c-d79190ef9e84 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.679910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8a2c4-7282-4029-a66c-d79190ef9e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.689103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85734ff-638a-45c4-94d5-99ba69903af2 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:31.695220 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a730c8-84e9-4d61-8b11-9cebfccb5537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:31.698088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a730c8-84e9-4d61-8b11-9cebfccb5537 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.698431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a730c8-84e9-4d61-8b11-9cebfccb5537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.698756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a730c8-84e9-4d61-8b11-9cebfccb5537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.699470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a730c8-84e9-4d61-8b11-9cebfccb5537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:31.701638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a730c8-84e9-4d61-8b11-9cebfccb5537 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:31.717827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 960/1915] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:31.718961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-68c8a2c4-7282-4029-a66c-d79190ef9e84 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:31.720211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-68c8a2c4-7282-4029-a66c-d79190ef9e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:31.722052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a730c8-84e9-4d61-8b11-9cebfccb5537 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:31.741212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 956/1916] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:31.745743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8a2c4-7282-4029-a66c-d79190ef9e84 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:31.748597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a730c8-84e9-4d61-8b11-9cebfccb5537 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:31.760337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03847de7-7934-42c3-8a5c-66cfe013a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:31.760876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8a2c4-7282-4029-a66c-d79190ef9e84 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:31.764136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03847de7-7934-42c3-8a5c-66cfe013a386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.764627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03847de7-7934-42c3-8a5c-66cfe013a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.765128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03847de7-7934-42c3-8a5c-66cfe013a386 admin admin] PATH_INFO: `/v3/projects/554efcc6e38849689e0bf06cd76ac60d/users/9283ee3f51f3447fb8cb9246f5f62483/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.774022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efcce3-9434-4f4e-8cde-1164012888ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:31.775443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efcce3-9434-4f4e-8cde-1164012888ca admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.775443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efcce3-9434-4f4e-8cde-1164012888ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.775706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efcce3-9434-4f4e-8cde-1164012888ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.776373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efcce3-9434-4f4e-8cde-1164012888ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:31.776668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efcce3-9434-4f4e-8cde-1164012888ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:31.778324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efcce3-9434-4f4e-8cde-1164012888ca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:31.806219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 957/1917] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:31.808828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03847de7-7934-42c3-8a5c-66cfe013a386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554efcc6e38849689e0bf06cd76ac60d, user_id=9283ee3f51f3447fb8cb9246f5f62483, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:31.810314 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efcce3-9434-4f4e-8cde-1164012888ca admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:31.812984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03847de7-7934-42c3-8a5c-66cfe013a386 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:31.828855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efcce3-9434-4f4e-8cde-1164012888ca admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:31.840215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d718c45-b08c-4311-9eea-67056178ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:31.840825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d718c45-b08c-4311-9eea-67056178ca61 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.841107 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d718c45-b08c-4311-9eea-67056178ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.841386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d718c45-b08c-4311-9eea-67056178ca61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.842143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d718c45-b08c-4311-9eea-67056178ca61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:31.845603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d718c45-b08c-4311-9eea-67056178ca61 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:31.880232 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 961/1918] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:31 2022] PUT /identity/v3/projects/554efcc6e38849689e0bf06cd76ac60d/users/9283ee3f51f3447fb8cb9246f5f62483/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:31.882588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3620c-43b7-490a-9526-639c4e4fb9fa None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:31.882921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3620c-43b7-490a-9526-639c4e4fb9fa None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:31.883198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3620c-43b7-490a-9526-639c4e4fb9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:31.918581 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 958/1919] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:31 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:31.919489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d718c45-b08c-4311-9eea-67056178ca61 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:31.928433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5d718c45-b08c-4311-9eea-67056178ca61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:32.034918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-74e3620c-43b7-490a-9526-639c4e4fb9fa None None] MFA Rules not processed for user `9283ee3f51f3447fb8cb9246f5f62483`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:32.039583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-74e3620c-43b7-490a-9526-639c4e4fb9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:32.079373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d718c45-b08c-4311-9eea-67056178ca61 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.089412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.090058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.090336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.090605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] PATH_INFO: `/v3/projects/fa9fbeccf9454848a6cb5c7859d6ff94` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.091905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9fbeccf9454848a6cb5c7859d6ff94)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.093961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.136220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:32.150665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 962/1920] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:32.151565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3620c-43b7-490a-9526-639c4e4fb9fa None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.164662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9fbeccf9454848a6cb5c7859d6ff94', 'request_id': 'req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:32.170531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9fbeccf9454848a6cb5c7859d6ff94', 'request_id': 'req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:32.171021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3620c-43b7-490a-9526-639c4e4fb9fa None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.181642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9fbeccf9454848a6cb5c7859d6ff94', 'request_id': 'req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:32.189720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:32.200315 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] The token cache is being invalidate because project fa9fbeccf9454848a6cb5c7859d6ff94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:32.200699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:32.201705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:32.205343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 959/1921] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:31 2022] DELETE /identity/v3/projects/fa9fbeccf9454848a6cb5c7859d6ff94 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:32.206261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.210282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:32.260492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218b1b4-042a-48ed-9f9b-b3d383f4323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.261991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218b1b4-042a-48ed-9f9b-b3d383f4323e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.262620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218b1b4-042a-48ed-9f9b-b3d383f4323e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.263306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218b1b4-042a-48ed-9f9b-b3d383f4323e admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.264580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218b1b4-042a-48ed-9f9b-b3d383f4323e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.267393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218b1b4-042a-48ed-9f9b-b3d383f4323e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.296877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 963/1922] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:32 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:32.299045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6638b4-c415-4b41-946c-21f1b0e5ad2f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.299351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6638b4-c415-4b41-946c-21f1b0e5ad2f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.299629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6638b4-c415-4b41-946c-21f1b0e5ad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.318747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50abd5-5c68-4bd1-b573-47ac8fd20b84 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.326749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f610-c118-4dc6-8e73-059926b0b8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.327392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f610-c118-4dc6-8e73-059926b0b8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.327684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f610-c118-4dc6-8e73-059926b0b8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.327966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f610-c118-4dc6-8e73-059926b0b8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.328741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f610-c118-4dc6-8e73-059926b0b8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.328857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7b6638b4-c415-4b41-946c-21f1b0e5ad2f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:32.330621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7b6638b4-c415-4b41-946c-21f1b0e5ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:32.330940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f610-c118-4dc6-8e73-059926b0b8e6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.360713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 964/1923] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:32.371586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6638b4-c415-4b41-946c-21f1b0e5ad2f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.374011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7b6638b4-c415-4b41-946c-21f1b0e5ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:32.391062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6638b4-c415-4b41-946c-21f1b0e5ad2f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.401248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 960/1924] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:32 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:32.408627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0a965-cb40-4fb6-80d9-0f837e0b36fb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.409187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0a965-cb40-4fb6-80d9-0f837e0b36fb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.409710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0a965-cb40-4fb6-80d9-0f837e0b36fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.436340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f4d0a965-cb40-4fb6-80d9-0f837e0b36fb None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:32.438322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f4d0a965-cb40-4fb6-80d9-0f837e0b36fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:32.470456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2945-dd47-42a9-b6ac-17720567b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.471999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2945-dd47-42a9-b6ac-17720567b375 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.471999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2945-dd47-42a9-b6ac-17720567b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.472274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2945-dd47-42a9-b6ac-17720567b375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.473515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a2945-dd47-42a9-b6ac-17720567b375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.475284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a2945-dd47-42a9-b6ac-17720567b375 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.490957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 965/1925] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:32.492057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2945-dd47-42a9-b6ac-17720567b375 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.504042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2945-dd47-42a9-b6ac-17720567b375 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.510296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93e89-5b5a-4278-ad87-db71b570880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.511042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93e89-5b5a-4278-ad87-db71b570880b admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.511379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93e89-5b5a-4278-ad87-db71b570880b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.511833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93e89-5b5a-4278-ad87-db71b570880b admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.512574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd93e89-5b5a-4278-ad87-db71b570880b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.514959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd93e89-5b5a-4278-ad87-db71b570880b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.548487 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 966/1926] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:32 2022] POST /identity/v3/users => generated 298 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:32.549627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93e89-5b5a-4278-ad87-db71b570880b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.566301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93e89-5b5a-4278-ad87-db71b570880b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.574572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4d618-4321-4a83-bf58-cd02419f069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.575210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4d618-4321-4a83-bf58-cd02419f069e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.575584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4d618-4321-4a83-bf58-cd02419f069e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.576076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4d618-4321-4a83-bf58-cd02419f069e admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.576825 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4d618-4321-4a83-bf58-cd02419f069e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.578861 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4d618-4321-4a83-bf58-cd02419f069e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.595984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 967/1927] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:32.597181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4d618-4321-4a83-bf58-cd02419f069e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.599011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 961/1928] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:32.600318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0a965-cb40-4fb6-80d9-0f837e0b36fb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.609153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4d618-4321-4a83-bf58-cd02419f069e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.613692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0a965-cb40-4fb6-80d9-0f837e0b36fb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.615924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959090ba-d898-4f2d-a825-ff88ef1d404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.616523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959090ba-d898-4f2d-a825-ff88ef1d404c admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.616805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959090ba-d898-4f2d-a825-ff88ef1d404c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.617125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959090ba-d898-4f2d-a825-ff88ef1d404c admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.617774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959090ba-d898-4f2d-a825-ff88ef1d404c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.619571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959090ba-d898-4f2d-a825-ff88ef1d404c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.620659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5ff75-9f72-4af5-b9d8-4b293e16054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.621609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5ff75-9f72-4af5-b9d8-4b293e16054f admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.622350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5ff75-9f72-4af5-b9d8-4b293e16054f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.622767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5ff75-9f72-4af5-b9d8-4b293e16054f admin admin] PATH_INFO: `/v3/projects/6056289b0a074a1999e5a2d7235a70f5/users/579c8b0900e446dcbb41b8fb35a2d7f8/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.632489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 968/1929] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:32.634046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959090ba-d898-4f2d-a825-ff88ef1d404c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.646897 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959090ba-d898-4f2d-a825-ff88ef1d404c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.654631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5ff75-9f72-4af5-b9d8-4b293e16054f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6056289b0a074a1999e5a2d7235a70f5, user_id=579c8b0900e446dcbb41b8fb35a2d7f8, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.655155 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a38f6-41fb-4865-b5f6-56a1c1b52dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.655457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a38f6-41fb-4865-b5f6-56a1c1b52dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.655769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a38f6-41fb-4865-b5f6-56a1c1b52dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.656112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a38f6-41fb-4865-b5f6-56a1c1b52dbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.656873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a38f6-41fb-4865-b5f6-56a1c1b52dbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:32.657242 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a38f6-41fb-4865-b5f6-56a1c1b52dbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.659605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5ff75-9f72-4af5-b9d8-4b293e16054f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.660698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a38f6-41fb-4865-b5f6-56a1c1b52dbf admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.681672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 969/1930] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:32.681672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a38f6-41fb-4865-b5f6-56a1c1b52dbf admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.686414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 962/1931] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:32 2022] PUT /identity/v3/projects/6056289b0a074a1999e5a2d7235a70f5/users/579c8b0900e446dcbb41b8fb35a2d7f8/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:32.687434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5ff75-9f72-4af5-b9d8-4b293e16054f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.704796 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a38f6-41fb-4865-b5f6-56a1c1b52dbf admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.713448 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:32.766125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:32.769340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5ff75-9f72-4af5-b9d8-4b293e16054f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.778699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7511a4-8f63-4bc1-adf2-3e54a0d3a947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.779076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7511a4-8f63-4bc1-adf2-3e54a0d3a947 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.779367 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7511a4-8f63-4bc1-adf2-3e54a0d3a947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.779646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7511a4-8f63-4bc1-adf2-3e54a0d3a947 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.780745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7511a4-8f63-4bc1-adf2-3e54a0d3a947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.782764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7511a4-8f63-4bc1-adf2-3e54a0d3a947 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.795462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c244-e16b-427f-a05b-eff1e8308f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.796700 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c244-e16b-427f-a05b-eff1e8308f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.797080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c244-e16b-427f-a05b-eff1e8308f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.797849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c244-e16b-427f-a05b-eff1e8308f74 admin admin] PATH_INFO: `/v3/projects/97c3f1976ae74435acf3c89083a4cb6a/users/f4fb3a5f7e0141b9850681f173dd4766/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.816868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929c244-e16b-427f-a05b-eff1e8308f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c3f1976ae74435acf3c89083a4cb6a, user_id=f4fb3a5f7e0141b9850681f173dd4766, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.817635 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 963/1932] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:32 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:32.819851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07939046-7824-4e18-b8c0-61e6c09e984e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.820160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07939046-7824-4e18-b8c0-61e6c09e984e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.820495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07939046-7824-4e18-b8c0-61e6c09e984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.821419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929c244-e16b-427f-a05b-eff1e8308f74 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.849237 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 970/1933] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:32 2022] PUT /identity/v3/projects/97c3f1976ae74435acf3c89083a4cb6a/users/f4fb3a5f7e0141b9850681f173dd4766/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:32.849237 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c244-e16b-427f-a05b-eff1e8308f74 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.857915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-07939046-7824-4e18-b8c0-61e6c09e984e None None] MFA Rules not processed for user `579c8b0900e446dcbb41b8fb35a2d7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:32.859170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07939046-7824-4e18-b8c0-61e6c09e984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:32.923829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c244-e16b-427f-a05b-eff1e8308f74 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.927268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 964/1934] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:32.928220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07939046-7824-4e18-b8c0-61e6c09e984e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.932209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5891-879a-4431-a60e-613d58843a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.933288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5891-879a-4431-a60e-613d58843a14 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.933288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5891-879a-4431-a60e-613d58843a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.933446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5891-879a-4431-a60e-613d58843a14 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.933987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c5891-879a-4431-a60e-613d58843a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.937025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c5891-879a-4431-a60e-613d58843a14 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.943017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07939046-7824-4e18-b8c0-61e6c09e984e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.948051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdde2f-8575-4b98-8ffa-ec09140f19e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.948665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdde2f-8575-4b98-8ffa-ec09140f19e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.948979 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdde2f-8575-4b98-8ffa-ec09140f19e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.949254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdde2f-8575-4b98-8ffa-ec09140f19e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.949904 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdde2f-8575-4b98-8ffa-ec09140f19e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.951549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdde2f-8575-4b98-8ffa-ec09140f19e2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.959854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 971/1935] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:32 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:32.960623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5891-879a-4431-a60e-613d58843a14 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.963079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-936c5891-879a-4431-a60e-613d58843a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:32.963868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 965/1936] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:32.964947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdde2f-8575-4b98-8ffa-ec09140f19e2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:32.975668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdde2f-8575-4b98-8ffa-ec09140f19e2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:32.981281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa56a-b6c3-4e6c-afd5-4ff3fa8fb4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:32.982284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa56a-b6c3-4e6c-afd5-4ff3fa8fb4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.982566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa56a-b6c3-4e6c-afd5-4ff3fa8fb4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.982875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa56a-b6c3-4e6c-afd5-4ff3fa8fb4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.983503 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa56a-b6c3-4e6c-afd5-4ff3fa8fb4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:32.985506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa56a-b6c3-4e6c-afd5-4ff3fa8fb4b9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:32.996062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 966/1937] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:32.997030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa56a-b6c3-4e6c-afd5-4ff3fa8fb4b9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.006855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa56a-b6c3-4e6c-afd5-4ff3fa8fb4b9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.012803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dc65c-e99f-40dc-907f-685585129040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.013460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dc65c-e99f-40dc-907f-685585129040 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.013741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dc65c-e99f-40dc-907f-685585129040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.014017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dc65c-e99f-40dc-907f-685585129040 admin admin] PATH_INFO: `/v3/projects/97c3f1976ae74435acf3c89083a4cb6a/users/f4fb3a5f7e0141b9850681f173dd4766/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.016095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dc65c-e99f-40dc-907f-685585129040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c3f1976ae74435acf3c89083a4cb6a, user_id=f4fb3a5f7e0141b9850681f173dd4766, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.018767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dc65c-e99f-40dc-907f-685585129040 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.022359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5891-879a-4431-a60e-613d58843a14 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.026681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa64618-ce52-4cda-9000-652e4259bfa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.027327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa64618-ce52-4cda-9000-652e4259bfa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.027603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa64618-ce52-4cda-9000-652e4259bfa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.027874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa64618-ce52-4cda-9000-652e4259bfa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.040552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa64618-ce52-4cda-9000-652e4259bfa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.040552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa64618-ce52-4cda-9000-652e4259bfa9 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.048666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 967/1938] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:32 2022] PUT /identity/v3/projects/97c3f1976ae74435acf3c89083a4cb6a/users/f4fb3a5f7e0141b9850681f173dd4766/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:33.049755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dc65c-e99f-40dc-907f-685585129040 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.050388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 972/1939] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:33.060294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e2ed-3989-4338-bd92-f81a0d42b007 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.060584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e2ed-3989-4338-bd92-f81a0d42b007 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.060862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e2ed-3989-4338-bd92-f81a0d42b007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.096432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c072e2ed-3989-4338-bd92-f81a0d42b007 None None] MFA Rules not processed for user `f4fb3a5f7e0141b9850681f173dd4766`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:33.097891 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c072e2ed-3989-4338-bd92-f81a0d42b007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:33.162143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:33.168211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:33.169592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dc65c-e99f-40dc-907f-685585129040 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.176722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b26b2-fcf8-4657-bca1-3549bf6c39cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.177439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b26b2-fcf8-4657-bca1-3549bf6c39cf admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.177723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b26b2-fcf8-4657-bca1-3549bf6c39cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.177990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b26b2-fcf8-4657-bca1-3549bf6c39cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.178634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b26b2-fcf8-4657-bca1-3549bf6c39cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.180503 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b26b2-fcf8-4657-bca1-3549bf6c39cf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.193523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 968/1940] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:33.198895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b26b2-fcf8-4657-bca1-3549bf6c39cf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.201642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 973/1941] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:33.215109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072e2ed-3989-4338-bd92-f81a0d42b007 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.217051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c072e2ed-3989-4338-bd92-f81a0d42b007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:33.223673 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b26b2-fcf8-4657-bca1-3549bf6c39cf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.231689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c54e37-888c-41cf-8816-7bc247486df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.232366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c54e37-888c-41cf-8816-7bc247486df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.232655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c54e37-888c-41cf-8816-7bc247486df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.232934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c54e37-888c-41cf-8816-7bc247486df5 admin admin] PATH_INFO: `/v3/projects/5fe673610a814b2eabea2933897d6e3e/users/28ea4c0059c94abeb1e09d62a275842b/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.259254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c54e37-888c-41cf-8816-7bc247486df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe673610a814b2eabea2933897d6e3e, user_id=28ea4c0059c94abeb1e09d62a275842b, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.262284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c54e37-888c-41cf-8816-7bc247486df5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.290790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 969/1942] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:33 2022] PUT /identity/v3/projects/5fe673610a814b2eabea2933897d6e3e/users/28ea4c0059c94abeb1e09d62a275842b/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:33.302498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab7010-7937-4d71-b9e3-fa79d38bb07b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.302818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab7010-7937-4d71-b9e3-fa79d38bb07b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.303091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab7010-7937-4d71-b9e3-fa79d38bb07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.321016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072e2ed-3989-4338-bd92-f81a0d42b007 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.341065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c1ab7010-7937-4d71-b9e3-fa79d38bb07b None None] MFA Rules not processed for user `28ea4c0059c94abeb1e09d62a275842b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:33.342443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c1ab7010-7937-4d71-b9e3-fa79d38bb07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:33.480653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 970/1943] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:33.484818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab7010-7937-4d71-b9e3-fa79d38bb07b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.487080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36b121-e914-4ae6-af1f-33c650d60242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.487705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b121-e914-4ae6-af1f-33c650d60242 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.487987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b121-e914-4ae6-af1f-33c650d60242 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.488661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b121-e914-4ae6-af1f-33c650d60242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.497433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9f36b121-e914-4ae6-af1f-33c650d60242 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:33.586137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab7010-7937-4d71-b9e3-fa79d38bb07b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.593920 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e2350-22c5-422b-ac15-f117f9aeeaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.594594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2350-22c5-422b-ac15-f117f9aeeaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.594932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2350-22c5-422b-ac15-f117f9aeeaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.595207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2350-22c5-422b-ac15-f117f9aeeaa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.595876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e2350-22c5-422b-ac15-f117f9aeeaa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.597790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e2350-22c5-422b-ac15-f117f9aeeaa0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.608297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36b121-e914-4ae6-af1f-33c650d60242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.610725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36b121-e914-4ae6-af1f-33c650d60242 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.628436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 974/1944] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:33.637052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 971/1945] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:33 2022] POST /identity/v3/projects => generated 391 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:33.641165 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36b121-e914-4ae6-af1f-33c650d60242 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.653259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36b121-e914-4ae6-af1f-33c650d60242 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.738761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:33.753420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f7a02-31cd-4fd3-96d4-4b53c9eed155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.754301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f7a02-31cd-4fd3-96d4-4b53c9eed155 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.754641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f7a02-31cd-4fd3-96d4-4b53c9eed155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.755051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f7a02-31cd-4fd3-96d4-4b53c9eed155 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.755765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f7a02-31cd-4fd3-96d4-4b53c9eed155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.757884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f7a02-31cd-4fd3-96d4-4b53c9eed155 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.783658 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 975/1946] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:33 2022] POST /identity/v3/users => generated 302 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:33.788724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e2350-22c5-422b-ac15-f117f9aeeaa0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.801422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e2350-22c5-422b-ac15-f117f9aeeaa0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.807761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9141423-6362-4784-bf77-d0691aac368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.809063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9141423-6362-4784-bf77-d0691aac368e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.809063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9141423-6362-4784-bf77-d0691aac368e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.809063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9141423-6362-4784-bf77-d0691aac368e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.809787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9141423-6362-4784-bf77-d0691aac368e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.811576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9141423-6362-4784-bf77-d0691aac368e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.823778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 972/1947] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:33.828205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f7a02-31cd-4fd3-96d4-4b53c9eed155 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.841728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f7a02-31cd-4fd3-96d4-4b53c9eed155 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.846868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d755c77-28e1-4a42-813e-a9dc258f5aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.847602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d755c77-28e1-4a42-813e-a9dc258f5aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.847877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d755c77-28e1-4a42-813e-a9dc258f5aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.848497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d755c77-28e1-4a42-813e-a9dc258f5aa1 admin admin] PATH_INFO: `/v3/projects/012820cef8174d86a4d6529b8add0d36/users/00de9a9830c74d25b651bf25949c2a40/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.874810 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d755c77-28e1-4a42-813e-a9dc258f5aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012820cef8174d86a4d6529b8add0d36, user_id=00de9a9830c74d25b651bf25949c2a40, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.877668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d755c77-28e1-4a42-813e-a9dc258f5aa1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.892769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 976/1948] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:33 2022] PUT /identity/v3/projects/012820cef8174d86a4d6529b8add0d36/users/00de9a9830c74d25b651bf25949c2a40/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:33.897095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9141423-6362-4784-bf77-d0691aac368e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.908018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9141423-6362-4784-bf77-d0691aac368e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.944028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:34.022332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760beff-4198-4bed-aa1d-3b740fc97f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:34.023203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760beff-4198-4bed-aa1d-3b740fc97f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:34.023679 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760beff-4198-4bed-aa1d-3b740fc97f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:34.024155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760beff-4198-4bed-aa1d-3b740fc97f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:34.025327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760beff-4198-4bed-aa1d-3b740fc97f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:34.027477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760beff-4198-4bed-aa1d-3b740fc97f5a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:34.041285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 973/1949] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:34.045595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d755c77-28e1-4a42-813e-a9dc258f5aa1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:34.081804 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d755c77-28e1-4a42-813e-a9dc258f5aa1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:34.090358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c96e87-7f5e-43e3-83a6-d08a528f42fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:34.094279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c96e87-7f5e-43e3-83a6-d08a528f42fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:34.094852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c96e87-7f5e-43e3-83a6-d08a528f42fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:34.095267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c96e87-7f5e-43e3-83a6-d08a528f42fb admin admin] PATH_INFO: `/v3/projects/012820cef8174d86a4d6529b8add0d36/users/00de9a9830c74d25b651bf25949c2a40/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:34.100109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c96e87-7f5e-43e3-83a6-d08a528f42fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=012820cef8174d86a4d6529b8add0d36, user_id=00de9a9830c74d25b651bf25949c2a40, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:34.105000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c96e87-7f5e-43e3-83a6-d08a528f42fb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:34.126199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 977/1950] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:34 2022] PUT /identity/v3/projects/012820cef8174d86a4d6529b8add0d36/users/00de9a9830c74d25b651bf25949c2a40/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:34.137903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6ef1c-2307-4127-89dc-146b3558ee5a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:34.138464 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6ef1c-2307-4127-89dc-146b3558ee5a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:34.138954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6ef1c-2307-4127-89dc-146b3558ee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:34.180804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-24f6ef1c-2307-4127-89dc-146b3558ee5a None None] MFA Rules not processed for user `00de9a9830c74d25b651bf25949c2a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:34.183398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-24f6ef1c-2307-4127-89dc-146b3558ee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:34.273162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 974/1951] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:34.284459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c96e87-7f5e-43e3-83a6-d08a528f42fb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:34.348041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c96e87-7f5e-43e3-83a6-d08a528f42fb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:34.353089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6985a-a22e-4313-94fc-8016cb0b6a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:34.354186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6985a-a22e-4313-94fc-8016cb0b6a5a service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:34.354186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6985a-a22e-4313-94fc-8016cb0b6a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:34.354381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6985a-a22e-4313-94fc-8016cb0b6a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:34.367245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6985a-a22e-4313-94fc-8016cb0b6a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:34.369090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6985a-a22e-4313-94fc-8016cb0b6a5a service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:34.380779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 978/1952] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:34.439424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6ef1c-2307-4127-89dc-146b3558ee5a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:34.451273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6ef1c-2307-4127-89dc-146b3558ee5a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:34.455459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcafc3-c797-4402-b5c9-4560d8d29338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:34.456171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcafc3-c797-4402-b5c9-4560d8d29338 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:34.456447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcafc3-c797-4402-b5c9-4560d8d29338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:34.456830 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcafc3-c797-4402-b5c9-4560d8d29338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:34.537978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcafc3-c797-4402-b5c9-4560d8d29338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:34.539549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcafc3-c797-4402-b5c9-4560d8d29338 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:34.551842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 975/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:34.959786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6985a-a22e-4313-94fc-8016cb0b6a5a service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:34.963923 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5da6985a-a22e-4313-94fc-8016cb0b6a5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:35.058598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6985a-a22e-4313-94fc-8016cb0b6a5a service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:35.065190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:35.065887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:35.066167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:35.066488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] PATH_INFO: `/v3/users/7931118ada9f40dbbc5a3c42c8a8c247` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:35.068541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=7931118ada9f40dbbc5a3c42c8a8c247)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:35.071289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:35.140241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7931118ada9f40dbbc5a3c42c8a8c247'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:35.141413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7931118ada9f40dbbc5a3c42c8a8c247'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:35.145132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:35.166089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7931118ada9f40dbbc5a3c42c8a8c247'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:35.178175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7931118ada9f40dbbc5a3c42c8a8c247'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:35.179295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7931118ada9f40dbbc5a3c42c8a8c247'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:35.200531 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 979/1954] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:34 2022] DELETE /identity/v3/users/7931118ada9f40dbbc5a3c42c8a8c247 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:35.202269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0606a-eb23-4231-b754-f462451ea2e6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:35.202746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0606a-eb23-4231-b754-f462451ea2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:35.203006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0606a-eb23-4231-b754-f462451ea2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:35.231112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0ea0606a-eb23-4231-b754-f462451ea2e6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:35.232757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0ea0606a-eb23-4231-b754-f462451ea2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:35.314361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:35.339392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 976/1955] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:35.345658 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:35.351548 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:35.356500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0606a-eb23-4231-b754-f462451ea2e6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:35.371286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0ea0606a-eb23-4231-b754-f462451ea2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:35.445287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e86fb1-b6cc-4125-a727-14b8a6187cde admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:35.450636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0606a-eb23-4231-b754-f462451ea2e6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:35.450816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5298f-a3c0-4f2a-8894-dbf613d4ad1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:35.450816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5298f-a3c0-4f2a-8894-dbf613d4ad1e service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:35.450816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5298f-a3c0-4f2a-8894-dbf613d4ad1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:35.451185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5298f-a3c0-4f2a-8894-dbf613d4ad1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:35.456962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6bd5298f-a3c0-4f2a-8894-dbf613d4ad1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:35.460563 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa510a1-e46c-4b2f-bdda-f77e3e8de1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:35.461288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa510a1-e46c-4b2f-bdda-f77e3e8de1ad service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:35.461579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa510a1-e46c-4b2f-bdda-f77e3e8de1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:35.461853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa510a1-e46c-4b2f-bdda-f77e3e8de1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:35.485195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa510a1-e46c-4b2f-bdda-f77e3e8de1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:35.486869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa510a1-e46c-4b2f-bdda-f77e3e8de1ad service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:35.498243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 977/1956] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:35.569868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5298f-a3c0-4f2a-8894-dbf613d4ad1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:35.572940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5298f-a3c0-4f2a-8894-dbf613d4ad1e service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:35.585789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 980/1957] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:35.846306 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa510a1-e46c-4b2f-bdda-f77e3e8de1ad service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:35.847971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cfa510a1-e46c-4b2f-bdda-f77e3e8de1ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:35.887110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa510a1-e46c-4b2f-bdda-f77e3e8de1ad service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:35.893757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:35.894912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:35.895277 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:35.896599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] PATH_INFO: `/v3/projects/80c53f0d56e442739570dbc15156cce4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:35.897043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c53f0d56e442739570dbc15156cce4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:35.900394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:35.975417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c53f0d56e442739570dbc15156cce4', 'request_id': 'req-5bf63a4a-3f80-4001-8b9a-b46a5116807b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:35.988226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c53f0d56e442739570dbc15156cce4', 'request_id': 'req-5bf63a4a-3f80-4001-8b9a-b46a5116807b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:35.999262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c53f0d56e442739570dbc15156cce4', 'request_id': 'req-5bf63a4a-3f80-4001-8b9a-b46a5116807b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.022726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] The token cache is being invalidate because project 80c53f0d56e442739570dbc15156cce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:36.023132 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.026283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.030294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 978/1958] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:35 2022] DELETE /identity/v3/projects/80c53f0d56e442739570dbc15156cce4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:36.032501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5298f-a3c0-4f2a-8894-dbf613d4ad1e service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:36.049815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5298f-a3c0-4f2a-8894-dbf613d4ad1e service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:36.138776 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:36.140196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:36.140489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:36.140782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] PATH_INFO: `/v3/users/8d0a1d452e8545ee9423ff48526231b0` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:36.142116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0a1d452e8545ee9423ff48526231b0)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:36.144293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:36.183657 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:36.223681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0a1d452e8545ee9423ff48526231b0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.226402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0a1d452e8545ee9423ff48526231b0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.251614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0a1d452e8545ee9423ff48526231b0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.269086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0a1d452e8545ee9423ff48526231b0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.270061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0a1d452e8545ee9423ff48526231b0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.298808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 981/1959] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:36 2022] DELETE /identity/v3/users/8d0a1d452e8545ee9423ff48526231b0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:36.591787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:36.593637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:36.733053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf63a4a-3f80-4001-8b9a-b46a5116807b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:36.745554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:36.747839 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:36.788610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:36.819059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee078c-76aa-462e-9a38-dbaafb175463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:36.819976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee078c-76aa-462e-9a38-dbaafb175463 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:36.820277 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee078c-76aa-462e-9a38-dbaafb175463 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:36.821225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee078c-76aa-462e-9a38-dbaafb175463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:36.823479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69ee078c-76aa-462e-9a38-dbaafb175463 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:36.834551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0648ce9-b431-41e6-8bc2-0338797ef768 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:36.842225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:36.842906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:36.843213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:36.843843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] PATH_INFO: `/v3/projects/d3a825ac0dde4486aa85bb3761abef91` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:36.845386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a825ac0dde4486aa85bb3761abef91)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:36.847494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:36.921783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a825ac0dde4486aa85bb3761abef91', 'request_id': 'req-32f14cc6-7fc6-438c-bbd0-706082a32f2d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.932299 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a825ac0dde4486aa85bb3761abef91', 'request_id': 'req-32f14cc6-7fc6-438c-bbd0-706082a32f2d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.946750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a825ac0dde4486aa85bb3761abef91', 'request_id': 'req-32f14cc6-7fc6-438c-bbd0-706082a32f2d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.962096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee078c-76aa-462e-9a38-dbaafb175463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:36.964042 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee078c-76aa-462e-9a38-dbaafb175463 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:36.970852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] The token cache is being invalidate because project d3a825ac0dde4486aa85bb3761abef91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:36.971146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.971851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:36.978643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 982/1960] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:36 2022] DELETE /identity/v3/projects/d3a825ac0dde4486aa85bb3761abef91 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:36.978643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:36.978643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:36.988587 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 979/1961] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:36.989742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0bf90-2857-42e2-bf83-c302bf444d94 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:36.990043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0bf90-2857-42e2-bf83-c302bf444d94 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:36.990326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0bf90-2857-42e2-bf83-c302bf444d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:37.025896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-aaf0bf90-2857-42e2-bf83-c302bf444d94 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:37.027618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:37.029903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aaf0bf90-2857-42e2-bf83-c302bf444d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:37.080987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f14cc6-7fc6-438c-bbd0-706082a32f2d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:37.104043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:37.104738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:37.105099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:37.105342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] PATH_INFO: `/v3/users/579c8b0900e446dcbb41b8fb35a2d7f8` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:37.106562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579c8b0900e446dcbb41b8fb35a2d7f8)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:37.108787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:37.204654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579c8b0900e446dcbb41b8fb35a2d7f8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:37.205965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 980/1962] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:37.206083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579c8b0900e446dcbb41b8fb35a2d7f8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:37.217728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1c3c7-a100-4c98-9ec1-03ec8f2909d2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:37.218330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1c3c7-a100-4c98-9ec1-03ec8f2909d2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:37.218818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1c3c7-a100-4c98-9ec1-03ec8f2909d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:37.234317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579c8b0900e446dcbb41b8fb35a2d7f8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:37.248810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7bd1c3c7-a100-4c98-9ec1-03ec8f2909d2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:37.251183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7bd1c3c7-a100-4c98-9ec1-03ec8f2909d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:37.256919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579c8b0900e446dcbb41b8fb35a2d7f8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:37.259064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-66ed9cee-cfd4-4856-b840-34ca5690e991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579c8b0900e446dcbb41b8fb35a2d7f8'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:37.292882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 981/1963] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:37.294453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1c3c7-a100-4c98-9ec1-03ec8f2909d2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:37.310220 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 983/1964] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:36 2022] DELETE /identity/v3/users/579c8b0900e446dcbb41b8fb35a2d7f8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:37.315354 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baecdd-8e75-41e7-9e55-9fa37b04714f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:37.315698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baecdd-8e75-41e7-9e55-9fa37b04714f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:37.316120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baecdd-8e75-41e7-9e55-9fa37b04714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:37.319341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1c3c7-a100-4c98-9ec1-03ec8f2909d2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:37.369466 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-11baecdd-8e75-41e7-9e55-9fa37b04714f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:37.370774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-11baecdd-8e75-41e7-9e55-9fa37b04714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:37.479614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d891e6d-0cbf-4236-b8f1-7eabcba19ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:37.481570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891e6d-0cbf-4236-b8f1-7eabcba19ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:37.482247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891e6d-0cbf-4236-b8f1-7eabcba19ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:37.483727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891e6d-0cbf-4236-b8f1-7eabcba19ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:37.485373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d891e6d-0cbf-4236-b8f1-7eabcba19ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:37.486182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d891e6d-0cbf-4236-b8f1-7eabcba19ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:37.489012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d891e6d-0cbf-4236-b8f1-7eabcba19ab5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:37.511510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 982/1965] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:37.517269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d891e6d-0cbf-4236-b8f1-7eabcba19ab5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:37.534444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 984/1966] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:37.536488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baecdd-8e75-41e7-9e55-9fa37b04714f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:37.541191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-11baecdd-8e75-41e7-9e55-9fa37b04714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:37.555858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d891e6d-0cbf-4236-b8f1-7eabcba19ab5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:37.573902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bced1-955c-4a7d-841d-fe5b378c7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:37.574550 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bced1-955c-4a7d-841d-fe5b378c7012 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:37.574934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bced1-955c-4a7d-841d-fe5b378c7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:37.575263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bced1-955c-4a7d-841d-fe5b378c7012 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:37.575891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bced1-955c-4a7d-841d-fe5b378c7012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:37.578606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bced1-955c-4a7d-841d-fe5b378c7012 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:37.616607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:37.617265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baecdd-8e75-41e7-9e55-9fa37b04714f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:37.623484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bacd3-1530-4cc3-ac12-1abdd4dd5441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:37.624265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bacd3-1530-4cc3-ac12-1abdd4dd5441 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:37.624911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bacd3-1530-4cc3-ac12-1abdd4dd5441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:37.625275 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bacd3-1530-4cc3-ac12-1abdd4dd5441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:37.635922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:37.642265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bacd3-1530-4cc3-ac12-1abdd4dd5441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:37.645189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bacd3-1530-4cc3-ac12-1abdd4dd5441 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:37.670661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 985/1967] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:37.672631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 983/1968] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:37 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:37.685034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bacd3-1530-4cc3-ac12-1abdd4dd5441 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:37.726075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bacd3-1530-4cc3-ac12-1abdd4dd5441 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:37.887378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c2b7c-e972-4d2f-8218-52d20cf82db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:37.888027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c2b7c-e972-4d2f-8218-52d20cf82db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:37.888371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c2b7c-e972-4d2f-8218-52d20cf82db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:37.888850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c2b7c-e972-4d2f-8218-52d20cf82db2 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:37.889577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c2b7c-e972-4d2f-8218-52d20cf82db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:37.891789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c2b7c-e972-4d2f-8218-52d20cf82db2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:37.942722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bced1-955c-4a7d-841d-fe5b378c7012 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:37.952766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 986/1969] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:37 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:37.957646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bced1-955c-4a7d-841d-fe5b378c7012 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:37.966633 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bab09-e3f5-4b60-a972-c4341e3674fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:37.968062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bab09-e3f5-4b60-a972-c4341e3674fe admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:37.968874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bab09-e3f5-4b60-a972-c4341e3674fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:37.974122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bab09-e3f5-4b60-a972-c4341e3674fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:37.974122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bab09-e3f5-4b60-a972-c4341e3674fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:37.974122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bab09-e3f5-4b60-a972-c4341e3674fe admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:37.994662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c2b7c-e972-4d2f-8218-52d20cf82db2 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:38.006970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 984/1970] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:38.013609 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c2b7c-e972-4d2f-8218-52d20cf82db2 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:38.021030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70c560-7f8e-4ce3-9a6c-d6e12cb7c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:38.021787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70c560-7f8e-4ce3-9a6c-d6e12cb7c06b admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:38.022645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70c560-7f8e-4ce3-9a6c-d6e12cb7c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:38.023098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70c560-7f8e-4ce3-9a6c-d6e12cb7c06b admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:38.024939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70c560-7f8e-4ce3-9a6c-d6e12cb7c06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:38.028371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70c560-7f8e-4ce3-9a6c-d6e12cb7c06b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:38.050337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 987/1971] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:38.051213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bab09-e3f5-4b60-a972-c4341e3674fe admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:38.069190 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bab09-e3f5-4b60-a972-c4341e3674fe admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:38.085832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63425e28-6896-45af-ba17-503d2832ed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:38.087256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63425e28-6896-45af-ba17-503d2832ed66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:38.087541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63425e28-6896-45af-ba17-503d2832ed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:38.087819 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63425e28-6896-45af-ba17-503d2832ed66 admin admin] PATH_INFO: `/v3/projects/87322cc3456a41c78eafcf7963ecbbd3/users/638b087f281c45ce81ac1d9cdd95b96d/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:38.124720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63425e28-6896-45af-ba17-503d2832ed66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87322cc3456a41c78eafcf7963ecbbd3, user_id=638b087f281c45ce81ac1d9cdd95b96d, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:38.127409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63425e28-6896-45af-ba17-503d2832ed66 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:38.158827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 985/1972] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:38 2022] PUT /identity/v3/projects/87322cc3456a41c78eafcf7963ecbbd3/users/638b087f281c45ce81ac1d9cdd95b96d/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:38.162062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33e47f-f3fd-4bd0-9038-b881c07ad1ce None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:38.162531 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33e47f-f3fd-4bd0-9038-b881c07ad1ce None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:38.162622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33e47f-f3fd-4bd0-9038-b881c07ad1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:38.214713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1f33e47f-f3fd-4bd0-9038-b881c07ad1ce None None] MFA Rules not processed for user `638b087f281c45ce81ac1d9cdd95b96d`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:38.215964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1f33e47f-f3fd-4bd0-9038-b881c07ad1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:38.244858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63425e28-6896-45af-ba17-503d2832ed66 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:38.248320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-63425e28-6896-45af-ba17-503d2832ed66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:38.368359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 988/1973] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:38.380037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33e47f-f3fd-4bd0-9038-b881c07ad1ce None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:38.382013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1f33e47f-f3fd-4bd0-9038-b881c07ad1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:38.386793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63425e28-6896-45af-ba17-503d2832ed66 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:38.392813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:38.393538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:38.393825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:38.394100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] PATH_INFO: `/v3/projects/6056289b0a074a1999e5a2d7235a70f5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:38.395256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6056289b0a074a1999e5a2d7235a70f5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:38.397313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:38.498176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6056289b0a074a1999e5a2d7235a70f5', 'request_id': 'req-c79a4e47-7a97-4865-a547-c923ae94dd27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:38.509079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:38.509457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6056289b0a074a1999e5a2d7235a70f5', 'request_id': 'req-c79a4e47-7a97-4865-a547-c923ae94dd27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:38.526457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6056289b0a074a1999e5a2d7235a70f5', 'request_id': 'req-c79a4e47-7a97-4865-a547-c923ae94dd27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:38.531470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33e47f-f3fd-4bd0-9038-b881c07ad1ce None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:38.557713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] The token cache is being invalidate because project 6056289b0a074a1999e5a2d7235a70f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:38.558174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:38.559318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c79a4e47-7a97-4865-a547-c923ae94dd27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:38.561007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 986/1974] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:38 2022] DELETE /identity/v3/projects/6056289b0a074a1999e5a2d7235a70f5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:38.568049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093edba6-7cc4-4f61-8037-a307a68cf1a1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:38.568475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093edba6-7cc4-4f61-8037-a307a68cf1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:38.568756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093edba6-7cc4-4f61-8037-a307a68cf1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:38.621066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-093edba6-7cc4-4f61-8037-a307a68cf1a1 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:38.624354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-093edba6-7cc4-4f61-8037-a307a68cf1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:38.698953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f0883-49bb-4696-929e-5035a97f49a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b2324f9166d4c2dac76f08b03991769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:38.698953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0883-49bb-4696-929e-5035a97f49a6 service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:38.698953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0883-49bb-4696-929e-5035a97f49a6 service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:38.698953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0883-49bb-4696-929e-5035a97f49a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:38.699336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-594f0883-49bb-4696-929e-5035a97f49a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:38.729235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:38.757391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 987/1975] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:38.767009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5e42-9a16-49e6-b567-e2fcf0f65958 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:38.767381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5e42-9a16-49e6-b567-e2fcf0f65958 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:38.767719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5e42-9a16-49e6-b567-e2fcf0f65958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:38.793012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f0883-49bb-4696-929e-5035a97f49a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:38.795546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f0883-49bb-4696-929e-5035a97f49a6 service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:38.806118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2a8c5e42-9a16-49e6-b567-e2fcf0f65958 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:38.810919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2a8c5e42-9a16-49e6-b567-e2fcf0f65958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:38.820593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 989/1976] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:38.826748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 988/1977] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:38.831240 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f0883-49bb-4696-929e-5035a97f49a6 service glance] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:38.845689 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f0883-49bb-4696-929e-5035a97f49a6 service glance] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:38.853835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98660c2-af4f-4580-bdc5-45236407a8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:38.854459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98660c2-af4f-4580-bdc5-45236407a8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:38.854830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98660c2-af4f-4580-bdc5-45236407a8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:38.855038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98660c2-af4f-4580-bdc5-45236407a8b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:38.855706 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98660c2-af4f-4580-bdc5-45236407a8b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:38.856010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98660c2-af4f-4580-bdc5-45236407a8b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:38.857871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98660c2-af4f-4580-bdc5-45236407a8b5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:38.875975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 990/1978] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:38.876431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c5e42-9a16-49e6-b567-e2fcf0f65958 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:38.888685 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c5e42-9a16-49e6-b567-e2fcf0f65958 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:38.895415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e8074-6593-4551-aa11-2e9396678ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:38.896395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e8074-6593-4551-aa11-2e9396678ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:38.896748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e8074-6593-4551-aa11-2e9396678ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:38.897092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e8074-6593-4551-aa11-2e9396678ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:38.897796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e8074-6593-4551-aa11-2e9396678ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:38.900897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e8074-6593-4551-aa11-2e9396678ec5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:38.953326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 989/1979] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:38 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:38.958311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98660c2-af4f-4580-bdc5-45236407a8b5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:38.971948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98660c2-af4f-4580-bdc5-45236407a8b5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.054588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2fc16-f583-40f9-9726-56c4b6387ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.056206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2fc16-f583-40f9-9726-56c4b6387ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.056505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2fc16-f583-40f9-9726-56c4b6387ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.056764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2fc16-f583-40f9-9726-56c4b6387ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.057465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2fc16-f583-40f9-9726-56c4b6387ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:39.061398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2fc16-f583-40f9-9726-56c4b6387ec3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:39.117032 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 991/1980] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:38 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:39.118845 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e8074-6593-4551-aa11-2e9396678ec5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.131566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e8074-6593-4551-aa11-2e9396678ec5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.139964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa26e38-1a6e-4043-b0e1-66624b506cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.140806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa26e38-1a6e-4043-b0e1-66624b506cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.141140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa26e38-1a6e-4043-b0e1-66624b506cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.141414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa26e38-1a6e-4043-b0e1-66624b506cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.142586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa26e38-1a6e-4043-b0e1-66624b506cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:39.145692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa26e38-1a6e-4043-b0e1-66624b506cb5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:39.160900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 990/1981] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:39.165860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2fc16-f583-40f9-9726-56c4b6387ec3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.176018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa26e38-1a6e-4043-b0e1-66624b506cb5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.180875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4fa26e38-1a6e-4043-b0e1-66624b506cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:39.187086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2fc16-f583-40f9-9726-56c4b6387ec3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.193328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e192b35-13b7-47a1-8408-e5acfdf1793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.193938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e192b35-13b7-47a1-8408-e5acfdf1793a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.194215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e192b35-13b7-47a1-8408-e5acfdf1793a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.194485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e192b35-13b7-47a1-8408-e5acfdf1793a admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.195377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e192b35-13b7-47a1-8408-e5acfdf1793a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:39.197137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e192b35-13b7-47a1-8408-e5acfdf1793a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:39.218404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 992/1982] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:39.219527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa26e38-1a6e-4043-b0e1-66624b506cb5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.219739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e192b35-13b7-47a1-8408-e5acfdf1793a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.228403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.229064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.229338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.229899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] PATH_INFO: `/v3/users/28ea4c0059c94abeb1e09d62a275842b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.231669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ea4c0059c94abeb1e09d62a275842b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:39.234638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:39.244149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e192b35-13b7-47a1-8408-e5acfdf1793a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.259591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff5514-54a8-4020-9759-a24d8e161f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.260272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff5514-54a8-4020-9759-a24d8e161f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.262666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff5514-54a8-4020-9759-a24d8e161f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.262998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff5514-54a8-4020-9759-a24d8e161f5a admin admin] PATH_INFO: `/v3/projects/706ef12b2b3346028bac3f828980704e/users/e6d4b3249c4a47ea94436a821c4c5cfe/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.290477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff5514-54a8-4020-9759-a24d8e161f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=706ef12b2b3346028bac3f828980704e, user_id=e6d4b3249c4a47ea94436a821c4c5cfe, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:39.293341 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff5514-54a8-4020-9759-a24d8e161f5a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:39.296359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:39.310773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ea4c0059c94abeb1e09d62a275842b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:39.312017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ea4c0059c94abeb1e09d62a275842b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:39.329455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 993/1983] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:39 2022] PUT /identity/v3/projects/706ef12b2b3346028bac3f828980704e/users/e6d4b3249c4a47ea94436a821c4c5cfe/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:39.333037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c98d-5306-4946-a26b-709d42c86a26 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.333324 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c98d-5306-4946-a26b-709d42c86a26 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.333516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ea4c0059c94abeb1e09d62a275842b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:39.334125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c98d-5306-4946-a26b-709d42c86a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.335338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ea4c0059c94abeb1e09d62a275842b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:39.352616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b4b0ac1-0a27-4137-9b76-f92bc63a80ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ea4c0059c94abeb1e09d62a275842b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:39.374742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3082c98d-5306-4946-a26b-709d42c86a26 None None] MFA Rules not processed for user `e6d4b3249c4a47ea94436a821c4c5cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:39.376298 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3082c98d-5306-4946-a26b-709d42c86a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:39.380993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 991/1984] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:39 2022] DELETE /identity/v3/users/28ea4c0059c94abeb1e09d62a275842b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:39.385781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eba4b3-674e-418c-bef3-ca3833d51019 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.388549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eba4b3-674e-418c-bef3-ca3833d51019 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.388980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eba4b3-674e-418c-bef3-ca3833d51019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.412297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c8eba4b3-674e-418c-bef3-ca3833d51019 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:39.415151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c8eba4b3-674e-418c-bef3-ca3833d51019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:39.524256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 994/1985] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:39.526743 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c98d-5306-4946-a26b-709d42c86a26 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.528948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 992/1986] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:39.529105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3082c98d-5306-4946-a26b-709d42c86a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:39.538598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eba4b3-674e-418c-bef3-ca3833d51019 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.540636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c8eba4b3-674e-418c-bef3-ca3833d51019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:39.564490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:39.615268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eba4b3-674e-418c-bef3-ca3833d51019 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.615629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c98d-5306-4946-a26b-709d42c86a26 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.620430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb96889-5c0d-41e7-a9ae-388cd969dae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.621084 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb96889-5c0d-41e7-a9ae-388cd969dae9 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.621671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d2b89-496d-4568-8281-865406a6a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.621767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb96889-5c0d-41e7-a9ae-388cd969dae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.621767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb96889-5c0d-41e7-a9ae-388cd969dae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.621914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d2b89-496d-4568-8281-865406a6a100 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.621999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d2b89-496d-4568-8281-865406a6a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.622248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d2b89-496d-4568-8281-865406a6a100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.622904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d2b89-496d-4568-8281-865406a6a100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:39.624802 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d2b89-496d-4568-8281-865406a6a100 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:39.632140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb96889-5c0d-41e7-a9ae-388cd969dae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:39.634271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb96889-5c0d-41e7-a9ae-388cd969dae9 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:39.657450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 995/1987] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:39 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:39.659763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 993/1988] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:39.667660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d2b89-496d-4568-8281-865406a6a100 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.752447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d2b89-496d-4568-8281-865406a6a100 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.758886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357665-7fd1-4f19-a3a5-446842f7272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.759562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357665-7fd1-4f19-a3a5-446842f7272d admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.759849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357665-7fd1-4f19-a3a5-446842f7272d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.760123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357665-7fd1-4f19-a3a5-446842f7272d admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.760817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64357665-7fd1-4f19-a3a5-446842f7272d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:39.763144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64357665-7fd1-4f19-a3a5-446842f7272d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:39.785253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:39.799009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 996/1989] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:39 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:39.800512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb96889-5c0d-41e7-a9ae-388cd969dae9 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.813596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb96889-5c0d-41e7-a9ae-388cd969dae9 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.846145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ef9ee-b69a-408f-8814-24095d87aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.849059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef9ee-b69a-408f-8814-24095d87aa11 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.849352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef9ee-b69a-408f-8814-24095d87aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.849708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef9ee-b69a-408f-8814-24095d87aa11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.852134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ef9ee-b69a-408f-8814-24095d87aa11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:39.860140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ef9ee-b69a-408f-8814-24095d87aa11 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:39.899767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 994/1990] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:39.901315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357665-7fd1-4f19-a3a5-446842f7272d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.916677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357665-7fd1-4f19-a3a5-446842f7272d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.922903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12f103-67b7-4bfc-9220-9645a165737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.923840 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f103-67b7-4bfc-9220-9645a165737d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.925530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f103-67b7-4bfc-9220-9645a165737d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.926035 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f103-67b7-4bfc-9220-9645a165737d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.927047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12f103-67b7-4bfc-9220-9645a165737d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:39.929810 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12f103-67b7-4bfc-9220-9645a165737d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:39.953188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ef9ee-b69a-408f-8814-24095d87aa11 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.954228 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 997/1991] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:39.966051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ef9ee-b69a-408f-8814-24095d87aa11 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.980598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb55f49-6fba-46a3-8a5e-2d3749155ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.982047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb55f49-6fba-46a3-8a5e-2d3749155ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.983040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb55f49-6fba-46a3-8a5e-2d3749155ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.983697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb55f49-6fba-46a3-8a5e-2d3749155ec1 admin admin] PATH_INFO: `/v3/projects/4f11d5a8dc334ab686bc2c6c1140af1f/users/85402b9097fe4cb6b2a47cb9da4ccb7c/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.029659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb55f49-6fba-46a3-8a5e-2d3749155ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f11d5a8dc334ab686bc2c6c1140af1f, user_id=85402b9097fe4cb6b2a47cb9da4ccb7c, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:40.035309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb55f49-6fba-46a3-8a5e-2d3749155ec1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:40.064684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 995/1992] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:39 2022] PUT /identity/v3/projects/4f11d5a8dc334ab686bc2c6c1140af1f/users/85402b9097fe4cb6b2a47cb9da4ccb7c/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:40.075772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548004f-927a-40a4-8940-a5677fb08cb5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:40.076071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548004f-927a-40a4-8940-a5677fb08cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:40.076293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548004f-927a-40a4-8940-a5677fb08cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.079588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb55f49-6fba-46a3-8a5e-2d3749155ec1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:40.081703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ddb55f49-6fba-46a3-8a5e-2d3749155ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:40.136892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9548004f-927a-40a4-8940-a5677fb08cb5 None None] MFA Rules not processed for user `85402b9097fe4cb6b2a47cb9da4ccb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:40.138117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9548004f-927a-40a4-8940-a5677fb08cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:40.243582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb55f49-6fba-46a3-8a5e-2d3749155ec1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:40.252110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:40.252757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:40.253158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:40.253436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] PATH_INFO: `/v3/projects/5fe673610a814b2eabea2933897d6e3e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.254575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe673610a814b2eabea2933897d6e3e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:40.261590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:40.316672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 998/1993] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:40.323063 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548004f-927a-40a4-8940-a5677fb08cb5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:40.340357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548004f-927a-40a4-8940-a5677fb08cb5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:40.356202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe673610a814b2eabea2933897d6e3e', 'request_id': 'req-a512070c-c042-4468-9b2c-96c7e80bf6ee'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:40.368386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe673610a814b2eabea2933897d6e3e', 'request_id': 'req-a512070c-c042-4468-9b2c-96c7e80bf6ee'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:40.379584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe673610a814b2eabea2933897d6e3e', 'request_id': 'req-a512070c-c042-4468-9b2c-96c7e80bf6ee'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:40.406009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] The token cache is being invalidate because project 5fe673610a814b2eabea2933897d6e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:40.406696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:40.407559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:40.413167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 996/1994] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:40 2022] DELETE /identity/v3/projects/5fe673610a814b2eabea2933897d6e3e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:40.415421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:40.418374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:40.443778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:40.478039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d431b-3404-4fb3-8765-fd1f7bb7f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:40.479136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d431b-3404-4fb3-8765-fd1f7bb7f754 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:40.479619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d431b-3404-4fb3-8765-fd1f7bb7f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:40.480083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d431b-3404-4fb3-8765-fd1f7bb7f754 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.482997 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d431b-3404-4fb3-8765-fd1f7bb7f754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:40.485549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d431b-3404-4fb3-8765-fd1f7bb7f754 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:40.514607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512070c-c042-4468-9b2c-96c7e80bf6ee admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:40.520471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:40.521024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:40.521349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:40.523894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] PATH_INFO: `/v3/users/00de9a9830c74d25b651bf25949c2a40` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.531527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00de9a9830c74d25b651bf25949c2a40)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:40.550322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 999/1995] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:40 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:40.550434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:40.550525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d431b-3404-4fb3-8765-fd1f7bb7f754 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:40.550525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3f2d431b-3404-4fb3-8765-fd1f7bb7f754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:40.628453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00de9a9830c74d25b651bf25949c2a40'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:40.629532 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00de9a9830c74d25b651bf25949c2a40'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:40.636353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d431b-3404-4fb3-8765-fd1f7bb7f754 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:40.638258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00de9a9830c74d25b651bf25949c2a40'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:40.639405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00de9a9830c74d25b651bf25949c2a40'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:40.642178 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed9a75-0d73-4367-b1b0-b510079f5499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:40.642938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed9a75-0d73-4367-b1b0-b510079f5499 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:40.643456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed9a75-0d73-4367-b1b0-b510079f5499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:40.643932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed9a75-0d73-4367-b1b0-b510079f5499 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.644654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed9a75-0d73-4367-b1b0-b510079f5499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:40.647733 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed9a75-0d73-4367-b1b0-b510079f5499 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:40.655815 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00de9a9830c74d25b651bf25949c2a40'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:40.671299 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:40.683037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 997/1996] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:40 2022] DELETE /identity/v3/users/00de9a9830c74d25b651bf25949c2a40 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:40.695000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1000/1997] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:40 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:40.699797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:40.701378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:40.850086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6710297-4f3f-40a2-9de6-28d862a91df6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:40.863171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b95ea6-b321-41e2-8163-0fd12718a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:40.864228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b95ea6-b321-41e2-8163-0fd12718a3ce admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:40.864728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b95ea6-b321-41e2-8163-0fd12718a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:40.866597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b95ea6-b321-41e2-8163-0fd12718a3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.868763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b95ea6-b321-41e2-8163-0fd12718a3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:40.873687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b95ea6-b321-41e2-8163-0fd12718a3ce admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:40.926008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 998/1998] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:40.931663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed9a75-0d73-4367-b1b0-b510079f5499 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:40.954556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed9a75-0d73-4367-b1b0-b510079f5499 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:40.960507 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a56c2-3b54-4c9d-bd80-cb08e0b66b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:40.962080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a56c2-3b54-4c9d-bd80-cb08e0b66b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:40.964988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a56c2-3b54-4c9d-bd80-cb08e0b66b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:40.964988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a56c2-3b54-4c9d-bd80-cb08e0b66b57 admin admin] PATH_INFO: `/v3/projects/b364766e0b244a16b7a515266264123b/users/17e834b71a084889bf2aa4186517a719/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.993840 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a56c2-3b54-4c9d-bd80-cb08e0b66b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b364766e0b244a16b7a515266264123b, user_id=17e834b71a084889bf2aa4186517a719, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:40.996881 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a56c2-3b54-4c9d-bd80-cb08e0b66b57 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:41.017148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1001/1999] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:40 2022] PUT /identity/v3/projects/b364766e0b244a16b7a515266264123b/users/17e834b71a084889bf2aa4186517a719/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:41.021772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b95ea6-b321-41e2-8163-0fd12718a3ce admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:41.036779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b95ea6-b321-41e2-8163-0fd12718a3ce admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:41.101327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:41.142941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91f12f-1005-4109-919b-015314b617e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:41.143368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91f12f-1005-4109-919b-015314b617e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:41.143704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91f12f-1005-4109-919b-015314b617e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:41.143985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91f12f-1005-4109-919b-015314b617e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:41.144973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91f12f-1005-4109-919b-015314b617e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:41.149599 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91f12f-1005-4109-919b-015314b617e1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:41.176065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a56c2-3b54-4c9d-bd80-cb08e0b66b57 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:41.176296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 999/2000] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:41.202246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a56c2-3b54-4c9d-bd80-cb08e0b66b57 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:41.212824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73852e4-f0d2-4d9e-81ac-2684317e2535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:41.213738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73852e4-f0d2-4d9e-81ac-2684317e2535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:41.214118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73852e4-f0d2-4d9e-81ac-2684317e2535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:41.214495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73852e4-f0d2-4d9e-81ac-2684317e2535 admin admin] PATH_INFO: `/v3/projects/b364766e0b244a16b7a515266264123b/users/17e834b71a084889bf2aa4186517a719/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:41.217628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73852e4-f0d2-4d9e-81ac-2684317e2535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b364766e0b244a16b7a515266264123b, user_id=17e834b71a084889bf2aa4186517a719, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:41.220421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73852e4-f0d2-4d9e-81ac-2684317e2535 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:41.250019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1002/2001] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:41 2022] PUT /identity/v3/projects/b364766e0b244a16b7a515266264123b/users/17e834b71a084889bf2aa4186517a719/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:41.251326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eca78c-b8ec-42f2-8e3c-40dffd1f7a92 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:41.251615 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eca78c-b8ec-42f2-8e3c-40dffd1f7a92 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:41.252490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eca78c-b8ec-42f2-8e3c-40dffd1f7a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:41.331317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-88eca78c-b8ec-42f2-8e3c-40dffd1f7a92 None None] MFA Rules not processed for user `17e834b71a084889bf2aa4186517a719`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:41.332601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-88eca78c-b8ec-42f2-8e3c-40dffd1f7a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:41.438761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1000/2002] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:41.454176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73852e4-f0d2-4d9e-81ac-2684317e2535 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:41.457096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d73852e4-f0d2-4d9e-81ac-2684317e2535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:41.617390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73852e4-f0d2-4d9e-81ac-2684317e2535 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:41.628431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2019c3a-a1e8-4b9d-ad72-e6a11b9f14ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:41.629071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2019c3a-a1e8-4b9d-ad72-e6a11b9f14ea service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:41.632305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2019c3a-a1e8-4b9d-ad72-e6a11b9f14ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:41.636074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2019c3a-a1e8-4b9d-ad72-e6a11b9f14ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:41.638953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eca78c-b8ec-42f2-8e3c-40dffd1f7a92 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:41.640552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-88eca78c-b8ec-42f2-8e3c-40dffd1f7a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:41.652516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f2019c3a-a1e8-4b9d-ad72-e6a11b9f14ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:41.833767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2019c3a-a1e8-4b9d-ad72-e6a11b9f14ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:41.835313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2019c3a-a1e8-4b9d-ad72-e6a11b9f14ea service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:41.849164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eca78c-b8ec-42f2-8e3c-40dffd1f7a92 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:41.853011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1003/2003] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:41.882005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:41.883535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:41.883979 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:41.884500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] PATH_INFO: `/v3/projects/012820cef8174d86a4d6529b8add0d36` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:41.888686 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=012820cef8174d86a4d6529b8add0d36)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:41.891393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:42.033098 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012820cef8174d86a4d6529b8add0d36', 'request_id': 'req-99c1cfc7-545f-4091-a236-e43bb79cb562'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:42.043026 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:42.045717 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012820cef8174d86a4d6529b8add0d36', 'request_id': 'req-99c1cfc7-545f-4091-a236-e43bb79cb562'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:42.065904 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012820cef8174d86a4d6529b8add0d36', 'request_id': 'req-99c1cfc7-545f-4091-a236-e43bb79cb562'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:42.094203 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2019c3a-a1e8-4b9d-ad72-e6a11b9f14ea service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:42.096606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f2019c3a-a1e8-4b9d-ad72-e6a11b9f14ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:42.103509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] The token cache is being invalidate because project 012820cef8174d86a4d6529b8add0d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:42.104031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:42.113185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99c1cfc7-545f-4091-a236-e43bb79cb562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:42.118276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1001/2004] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:41 2022] DELETE /identity/v3/projects/012820cef8174d86a4d6529b8add0d36 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:42.124354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f213f8-5257-4b5b-8fd1-1895f2c5e478 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.128126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2019c3a-a1e8-4b9d-ad72-e6a11b9f14ea service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:42.129491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f213f8-5257-4b5b-8fd1-1895f2c5e478 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.130722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f213f8-5257-4b5b-8fd1-1895f2c5e478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:42.196377 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a2f213f8-5257-4b5b-8fd1-1895f2c5e478 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:42.197907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a2f213f8-5257-4b5b-8fd1-1895f2c5e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:42.279274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:42.281632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.281632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.281632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] PATH_INFO: `/v3/users/3bb28460d1a14e24b6567b937e2640d5` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:42.283535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb28460d1a14e24b6567b937e2640d5)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:42.287072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:42.303661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:42.333203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1002/2005] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:42.334945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a8cf-46d8-40ce-94d8-312de3295116 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.335214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a8cf-46d8-40ce-94d8-312de3295116 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.335527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a8cf-46d8-40ce-94d8-312de3295116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:42.397527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7d30a8cf-46d8-40ce-94d8-312de3295116 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:42.400153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7d30a8cf-46d8-40ce-94d8-312de3295116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:42.423366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb28460d1a14e24b6567b937e2640d5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:42.423923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1003/2006] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:42.433730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb28460d1a14e24b6567b937e2640d5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:42.438211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30a8cf-46d8-40ce-94d8-312de3295116 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:42.463101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30a8cf-46d8-40ce-94d8-312de3295116 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:42.470416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb28460d1a14e24b6567b937e2640d5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:42.479796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432b8be-06dc-447e-837a-227ea29badfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:42.480432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b8be-06dc-447e-837a-227ea29badfa admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.480710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b8be-06dc-447e-837a-227ea29badfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.481127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b8be-06dc-447e-837a-227ea29badfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:42.481829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432b8be-06dc-447e-837a-227ea29badfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:42.482069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432b8be-06dc-447e-837a-227ea29badfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:42.484411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432b8be-06dc-447e-837a-227ea29badfa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:42.500122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1004/2007] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:42.504434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432b8be-06dc-447e-837a-227ea29badfa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:42.505129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb28460d1a14e24b6567b937e2640d5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:42.508984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-22103412-9676-466e-acba-4f16293f4ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb28460d1a14e24b6567b937e2640d5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:42.516630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432b8be-06dc-447e-837a-227ea29badfa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:42.522348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aada5a1-a126-4851-ba60-27671fd4c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:42.523839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aada5a1-a126-4851-ba60-27671fd4c298 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.524361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aada5a1-a126-4851-ba60-27671fd4c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.524534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aada5a1-a126-4851-ba60-27671fd4c298 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:42.525339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aada5a1-a126-4851-ba60-27671fd4c298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:42.527714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aada5a1-a126-4851-ba60-27671fd4c298 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:42.534067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1004/2008] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:42 2022] DELETE /identity/v3/users/3bb28460d1a14e24b6567b937e2640d5 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:42.540229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344c01-728b-4d58-a653-a288a6840b0f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.540592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344c01-728b-4d58-a653-a288a6840b0f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.540937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344c01-728b-4d58-a653-a288a6840b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:42.569494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-91344c01-728b-4d58-a653-a288a6840b0f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:42.572020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-91344c01-728b-4d58-a653-a288a6840b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:42.586323 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1005/2009] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:42 2022] POST /identity/v3/projects => generated 409 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:42.589875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aada5a1-a126-4851-ba60-27671fd4c298 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:42.594354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3aada5a1-a126-4851-ba60-27671fd4c298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:42.666166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1005/2010] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:42.682439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91344c01-728b-4d58-a653-a288a6840b0f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:42.685815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-91344c01-728b-4d58-a653-a288a6840b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:42.775635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91344c01-728b-4d58-a653-a288a6840b0f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:42.805077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aada5a1-a126-4851-ba60-27671fd4c298 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:42.817330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db363e6-592e-4991-9b8b-fb12b1406a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:42.819358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db363e6-592e-4991-9b8b-fb12b1406a52 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.821319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db363e6-592e-4991-9b8b-fb12b1406a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.822012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db363e6-592e-4991-9b8b-fb12b1406a52 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:42.823609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db363e6-592e-4991-9b8b-fb12b1406a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:42.827672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db363e6-592e-4991-9b8b-fb12b1406a52 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:42.862244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:42.871899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1006/2011] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:42 2022] POST /identity/v3/users => generated 305 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:42.873283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db363e6-592e-4991-9b8b-fb12b1406a52 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:42.874623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042c2c2-aeb6-4d25-9c11-82713aa7bb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:42.875269 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042c2c2-aeb6-4d25-9c11-82713aa7bb7d service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.875549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042c2c2-aeb6-4d25-9c11-82713aa7bb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.875847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042c2c2-aeb6-4d25-9c11-82713aa7bb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:42.888164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db363e6-592e-4991-9b8b-fb12b1406a52 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:42.889901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042c2c2-aeb6-4d25-9c11-82713aa7bb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:42.891413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042c2c2-aeb6-4d25-9c11-82713aa7bb7d service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:42.894359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2fd22-9fe4-4007-947a-5d39d1d614b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:42.895170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2fd22-9fe4-4007-947a-5d39d1d614b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.895517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2fd22-9fe4-4007-947a-5d39d1d614b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.895862 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2fd22-9fe4-4007-947a-5d39d1d614b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:42.896657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2fd22-9fe4-4007-947a-5d39d1d614b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:42.899217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2fd22-9fe4-4007-947a-5d39d1d614b9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:42.905079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1006/2012] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:42.916547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1007/2013] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:42.919453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042c2c2-aeb6-4d25-9c11-82713aa7bb7d service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:42.932296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042c2c2-aeb6-4d25-9c11-82713aa7bb7d service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:42.937808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e4a22-c768-424c-bb9d-6e53b538de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:42.938424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4a22-c768-424c-bb9d-6e53b538de13 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.938732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4a22-c768-424c-bb9d-6e53b538de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.939010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4a22-c768-424c-bb9d-6e53b538de13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:42.940406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e4a22-c768-424c-bb9d-6e53b538de13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:42.942149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e4a22-c768-424c-bb9d-6e53b538de13 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:42.959071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1007/2014] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:42.964822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2fd22-9fe4-4007-947a-5d39d1d614b9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:42.980663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2fd22-9fe4-4007-947a-5d39d1d614b9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:42.990021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec901b9a-9511-43b9-b48b-9d970badd676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:42.991498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec901b9a-9511-43b9-b48b-9d970badd676 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:42.991895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec901b9a-9511-43b9-b48b-9d970badd676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:42.992965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec901b9a-9511-43b9-b48b-9d970badd676 admin admin] PATH_INFO: `/v3/projects/788f80cd759b4bfb9764f4d1c35e49bc/users/b88a5fb265194297825ba74e6bdc512e/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.023078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec901b9a-9511-43b9-b48b-9d970badd676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=788f80cd759b4bfb9764f4d1c35e49bc, user_id=b88a5fb265194297825ba74e6bdc512e, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:43.027380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec901b9a-9511-43b9-b48b-9d970badd676 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:43.033290 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:43.063954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1008/2015] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:42 2022] PUT /identity/v3/projects/788f80cd759b4bfb9764f4d1c35e49bc/users/b88a5fb265194297825ba74e6bdc512e/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:43.075594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145534-5e50-495b-a2b8-ecd1db0f1ecb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.076041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145534-5e50-495b-a2b8-ecd1db0f1ecb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.076415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145534-5e50-495b-a2b8-ecd1db0f1ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.119766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-52145534-5e50-495b-a2b8-ecd1db0f1ecb None None] MFA Rules not processed for user `b88a5fb265194297825ba74e6bdc512e`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:43.121483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-52145534-5e50-495b-a2b8-ecd1db0f1ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:43.223605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1008/2016] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:43 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:43.227338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec901b9a-9511-43b9-b48b-9d970badd676 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:43.295347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52145534-5e50-495b-a2b8-ecd1db0f1ecb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:43.297293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-52145534-5e50-495b-a2b8-ecd1db0f1ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:43.309197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec901b9a-9511-43b9-b48b-9d970badd676 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:43.314555 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d4488-d995-4368-a2d8-7a1e516c5beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:43.315423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4488-d995-4368-a2d8-7a1e516c5beb admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.315715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4488-d995-4368-a2d8-7a1e516c5beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.316073 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4488-d995-4368-a2d8-7a1e516c5beb admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.316774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d4488-d995-4368-a2d8-7a1e516c5beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:43.317283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52145534-5e50-495b-a2b8-ecd1db0f1ecb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:43.318888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d4488-d995-4368-a2d8-7a1e516c5beb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:43.335775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:43.336682 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.337295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.337548 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] PATH_INFO: `/v3/projects/857a9bd4987b4dfea95341dab96afb53` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.339058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=857a9bd4987b4dfea95341dab96afb53)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:43.341352 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:43.361547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1009/2017] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:43 2022] POST /identity/v3/projects => generated 409 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:43.362933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d4488-d995-4368-a2d8-7a1e516c5beb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:43.422428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857a9bd4987b4dfea95341dab96afb53', 'request_id': 'req-45fb12d5-0fed-433a-bf29-00407d49cca1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:43.433157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857a9bd4987b4dfea95341dab96afb53', 'request_id': 'req-45fb12d5-0fed-433a-bf29-00407d49cca1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:43.443948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857a9bd4987b4dfea95341dab96afb53', 'request_id': 'req-45fb12d5-0fed-433a-bf29-00407d49cca1'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:43.446635 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d4488-d995-4368-a2d8-7a1e516c5beb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:43.464744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] The token cache is being invalidate because project 857a9bd4987b4dfea95341dab96afb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:43.465041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:43.466164 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:43.470563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1009/2018] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:43 2022] DELETE /identity/v3/projects/857a9bd4987b4dfea95341dab96afb53 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:43.472082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:43.473620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:43.522210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099e02-3aae-429f-9ab4-b611830b41fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:43.522992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099e02-3aae-429f-9ab4-b611830b41fb admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.523984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099e02-3aae-429f-9ab4-b611830b41fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.524479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099e02-3aae-429f-9ab4-b611830b41fb admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.525174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e099e02-3aae-429f-9ab4-b611830b41fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:43.527358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e099e02-3aae-429f-9ab4-b611830b41fb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:43.537654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:43.564418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1010/2019] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:43 2022] POST /identity/v3/users => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:43.568391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099e02-3aae-429f-9ab4-b611830b41fb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:43.571325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1e099e02-3aae-429f-9ab4-b611830b41fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:43.573866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb12d5-0fed-433a-bf29-00407d49cca1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:43.583825 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:43.584497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.584786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.585434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] PATH_INFO: `/v3/users/9283ee3f51f3447fb8cb9246f5f62483` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.587934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9283ee3f51f3447fb8cb9246f5f62483)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:43.595874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:43.604529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099e02-3aae-429f-9ab4-b611830b41fb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:43.610937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44fdd5-f7c6-4bb8-9df9-cb4327dc8f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:43.611749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44fdd5-f7c6-4bb8-9df9-cb4327dc8f2a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.612299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44fdd5-f7c6-4bb8-9df9-cb4327dc8f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.615947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44fdd5-f7c6-4bb8-9df9-cb4327dc8f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.616848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44fdd5-f7c6-4bb8-9df9-cb4327dc8f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:43.619278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44fdd5-f7c6-4bb8-9df9-cb4327dc8f2a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:43.634468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1011/2020] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:43.636210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44fdd5-f7c6-4bb8-9df9-cb4327dc8f2a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:43.647895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44fdd5-f7c6-4bb8-9df9-cb4327dc8f2a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:43.653840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2c796-724f-4791-bf82-a56a1369987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:43.654574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2c796-724f-4791-bf82-a56a1369987b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.654879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2c796-724f-4791-bf82-a56a1369987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.655234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2c796-724f-4791-bf82-a56a1369987b admin admin] PATH_INFO: `/v3/projects/5fb84df538ef47668de1e5a934253efa/users/cf62f98248654ce68505f66368455f15/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.658122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:43.672494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9283ee3f51f3447fb8cb9246f5f62483'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:43.673088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9283ee3f51f3447fb8cb9246f5f62483'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:43.681593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2c796-724f-4791-bf82-a56a1369987b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb84df538ef47668de1e5a934253efa, user_id=cf62f98248654ce68505f66368455f15, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:43.684545 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2c796-724f-4791-bf82-a56a1369987b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:43.691136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9283ee3f51f3447fb8cb9246f5f62483'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:43.701598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9283ee3f51f3447fb8cb9246f5f62483'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:43.702310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9283ee3f51f3447fb8cb9246f5f62483'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:43.704085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1012/2021] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:43 2022] PUT /identity/v3/projects/5fb84df538ef47668de1e5a934253efa/users/cf62f98248654ce68505f66368455f15/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:43.705471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2c796-724f-4791-bf82-a56a1369987b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:43.707938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eea2c796-724f-4791-bf82-a56a1369987b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:43.720031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1010/2022] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:43 2022] DELETE /identity/v3/users/9283ee3f51f3447fb8cb9246f5f62483 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:43.721144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:43.722539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:43.780990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2c796-724f-4791-bf82-a56a1369987b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:43.839368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283285-d605-4ebb-bfba-0a45bb006ba8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:43.844371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a553c6-41d1-46dd-be28-2911fa8970f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:43.844940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a553c6-41d1-46dd-be28-2911fa8970f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.845222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a553c6-41d1-46dd-be28-2911fa8970f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.845492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a553c6-41d1-46dd-be28-2911fa8970f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.846245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a553c6-41d1-46dd-be28-2911fa8970f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:43.846716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c48b25-382d-4a2c-b9bd-459429d8150d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:43.848066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a553c6-41d1-46dd-be28-2911fa8970f4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:43.848719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c48b25-382d-4a2c-b9bd-459429d8150d service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.849153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c48b25-382d-4a2c-b9bd-459429d8150d service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.849643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c48b25-382d-4a2c-b9bd-459429d8150d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.852842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-91c48b25-382d-4a2c-b9bd-459429d8150d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:43.867965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1011/2023] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:43.872174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a553c6-41d1-46dd-be28-2911fa8970f4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:43.884521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a553c6-41d1-46dd-be28-2911fa8970f4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:43.895425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56effb-2350-4b5d-8b9c-59546a564014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:43.896162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56effb-2350-4b5d-8b9c-59546a564014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.896446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56effb-2350-4b5d-8b9c-59546a564014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.896956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56effb-2350-4b5d-8b9c-59546a564014 admin admin] PATH_INFO: `/v3/projects/5fb84df538ef47668de1e5a934253efa/users/cf62f98248654ce68505f66368455f15/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.900050 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56effb-2350-4b5d-8b9c-59546a564014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb84df538ef47668de1e5a934253efa, user_id=cf62f98248654ce68505f66368455f15, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:43.903923 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56effb-2350-4b5d-8b9c-59546a564014 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:43.923413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1012/2024] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:43 2022] PUT /identity/v3/projects/5fb84df538ef47668de1e5a934253efa/users/cf62f98248654ce68505f66368455f15/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:43.932545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2db10d-ce09-4e6d-9916-1eff2d041d30 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.932835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2db10d-ce09-4e6d-9916-1eff2d041d30 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.933116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2db10d-ce09-4e6d-9916-1eff2d041d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.950426 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c48b25-382d-4a2c-b9bd-459429d8150d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:43.952062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c48b25-382d-4a2c-b9bd-459429d8150d service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:43.964349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2e2db10d-ce09-4e6d-9916-1eff2d041d30 None None] MFA Rules not processed for user `cf62f98248654ce68505f66368455f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:43.965595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2e2db10d-ce09-4e6d-9916-1eff2d041d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:43.966163 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1013/2025] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:44.058332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:44.144479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1013/2026] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:43 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:44.178789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c48b25-382d-4a2c-b9bd-459429d8150d service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:44.183727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-91c48b25-382d-4a2c-b9bd-459429d8150d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:44.198602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2db10d-ce09-4e6d-9916-1eff2d041d30 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:44.201791 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2e2db10d-ce09-4e6d-9916-1eff2d041d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:44.224289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c48b25-382d-4a2c-b9bd-459429d8150d service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:44.299008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:44.310469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:44.311607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:44.312103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:44.312473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] PATH_INFO: `/v3/projects/554efcc6e38849689e0bf06cd76ac60d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:44.314196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=554efcc6e38849689e0bf06cd76ac60d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:44.314319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2db10d-ce09-4e6d-9916-1eff2d041d30 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:44.317748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:44.320572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c2a95-9bad-4d5d-a968-4a31dc9e8b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:44.321407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c2a95-9bad-4d5d-a968-4a31dc9e8b9c service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:44.321714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c2a95-9bad-4d5d-a968-4a31dc9e8b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:44.324456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c2a95-9bad-4d5d-a968-4a31dc9e8b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:44.334642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c2a95-9bad-4d5d-a968-4a31dc9e8b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:44.336467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c2a95-9bad-4d5d-a968-4a31dc9e8b9c service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:44.348141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1014/2027] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:44 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:44.374988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554efcc6e38849689e0bf06cd76ac60d', 'request_id': 'req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:44.386408 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554efcc6e38849689e0bf06cd76ac60d', 'request_id': 'req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:44.400548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554efcc6e38849689e0bf06cd76ac60d', 'request_id': 'req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:44.413536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] The token cache is being invalidate because project 554efcc6e38849689e0bf06cd76ac60d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:44.414227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:44.414992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:44.419516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1014/2028] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:44 2022] DELETE /identity/v3/projects/554efcc6e38849689e0bf06cd76ac60d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:44.420816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c2a95-9bad-4d5d-a968-4a31dc9e8b9c service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:44.444225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c2a95-9bad-4d5d-a968-4a31dc9e8b9c service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:44.516057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:44.517525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:44.517977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:44.518414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] PATH_INFO: `/v3/users/f4fb3a5f7e0141b9850681f173dd4766` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:44.519716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4fb3a5f7e0141b9850681f173dd4766)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:44.521648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:44.583081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:44.585076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:44.593722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4fb3a5f7e0141b9850681f173dd4766'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:44.595022 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4fb3a5f7e0141b9850681f173dd4766'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:44.611032 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4fb3a5f7e0141b9850681f173dd4766'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:44.622535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4fb3a5f7e0141b9850681f173dd4766'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:44.623419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4fb3a5f7e0141b9850681f173dd4766'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:44.635043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:44.650019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1015/2029] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:44 2022] DELETE /identity/v3/users/f4fb3a5f7e0141b9850681f173dd4766 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:44.663049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9731f9-189c-4ca4-8aa4-821bfe7bcb12 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:44.719999 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f3ce3-b950-43bb-905e-a6d85d8b1fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:44.720613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f3ce3-b950-43bb-905e-a6d85d8b1fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:44.720888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f3ce3-b950-43bb-905e-a6d85d8b1fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:44.721156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f3ce3-b950-43bb-905e-a6d85d8b1fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:44.722963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-651f3ce3-b950-43bb-905e-a6d85d8b1fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:44.797404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:44.802260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f3ce3-b950-43bb-905e-a6d85d8b1fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:44.804024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f3ce3-b950-43bb-905e-a6d85d8b1fd1 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:44.822551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:44.824198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:44.833129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1015/2030] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:44 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:44.844203 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ee37d-8ab2-46e0-a910-9ea7a34b5560 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:44.851903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd80a4-aa44-4888-bd8b-dd9a8cf12b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:44.852538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd80a4-aa44-4888-bd8b-dd9a8cf12b8e service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:44.852814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd80a4-aa44-4888-bd8b-dd9a8cf12b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:44.853078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd80a4-aa44-4888-bd8b-dd9a8cf12b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:44.855406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-72bd80a4-aa44-4888-bd8b-dd9a8cf12b8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:44.937437 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd80a4-aa44-4888-bd8b-dd9a8cf12b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:44.938986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd80a4-aa44-4888-bd8b-dd9a8cf12b8e service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:44.955177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1016/2031] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:44.977568 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f3ce3-b950-43bb-905e-a6d85d8b1fd1 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:44.980506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-651f3ce3-b950-43bb-905e-a6d85d8b1fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:45.089726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f3ce3-b950-43bb-905e-a6d85d8b1fd1 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:45.095875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:45.096667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.097068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.097528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] PATH_INFO: `/v3/projects/97c3f1976ae74435acf3c89083a4cb6a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.098690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c3f1976ae74435acf3c89083a4cb6a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:45.100759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:45.186915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c3f1976ae74435acf3c89083a4cb6a', 'request_id': 'req-890639ac-3f82-4378-bd11-41aad5fa323b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:45.213494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c3f1976ae74435acf3c89083a4cb6a', 'request_id': 'req-890639ac-3f82-4378-bd11-41aad5fa323b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:45.220088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c3f1976ae74435acf3c89083a4cb6a', 'request_id': 'req-890639ac-3f82-4378-bd11-41aad5fa323b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:45.240009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] The token cache is being invalidate because project 97c3f1976ae74435acf3c89083a4cb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:45.240975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:45.242538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-890639ac-3f82-4378-bd11-41aad5fa323b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:45.245153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1016/2032] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:44 2022] DELETE /identity/v3/projects/97c3f1976ae74435acf3c89083a4cb6a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:45.250175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a902af-379b-416c-ad3f-20f1163613c2 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.250368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a902af-379b-416c-ad3f-20f1163613c2 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.250612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a902af-379b-416c-ad3f-20f1163613c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.272864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e3a902af-379b-416c-ad3f-20f1163613c2 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:45.274118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e3a902af-379b-416c-ad3f-20f1163613c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:45.338590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1017/2033] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:45.346531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94a3e4-947e-49d2-8d1f-546995f977f6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.346855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94a3e4-947e-49d2-8d1f-546995f977f6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.347135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94a3e4-947e-49d2-8d1f-546995f977f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.367968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7e94a3e4-947e-49d2-8d1f-546995f977f6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:45.369184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7e94a3e4-947e-49d2-8d1f-546995f977f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:45.377263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1017/2034] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:45.381590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a902af-379b-416c-ad3f-20f1163613c2 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:45.391467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a902af-379b-416c-ad3f-20f1163613c2 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:45.396045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1869e-70d5-430b-acbf-9fa4a9978f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:45.396647 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1869e-70d5-430b-acbf-9fa4a9978f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.396930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1869e-70d5-430b-acbf-9fa4a9978f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.397201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1869e-70d5-430b-acbf-9fa4a9978f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.397843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1869e-70d5-430b-acbf-9fa4a9978f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:45.398698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1869e-70d5-430b-acbf-9fa4a9978f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:45.400318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1869e-70d5-430b-acbf-9fa4a9978f86 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:45.412184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1018/2035] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:45.417314 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94a3e4-947e-49d2-8d1f-546995f977f6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:45.426515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94a3e4-947e-49d2-8d1f-546995f977f6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:45.431611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e8278-c72b-4ff7-a4bc-b96471626c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:45.432264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8278-c72b-4ff7-a4bc-b96471626c86 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.432498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8278-c72b-4ff7-a4bc-b96471626c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.432779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8278-c72b-4ff7-a4bc-b96471626c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.433528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e8278-c72b-4ff7-a4bc-b96471626c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:45.435518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e8278-c72b-4ff7-a4bc-b96471626c86 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:45.470239 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1018/2036] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:45 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:45.474574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1869e-70d5-430b-acbf-9fa4a9978f86 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:45.486798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1869e-70d5-430b-acbf-9fa4a9978f86 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:45.555823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af486c6-45af-4ba9-af79-8af46cbcb0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:45.556399 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af486c6-45af-4ba9-af79-8af46cbcb0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.556612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af486c6-45af-4ba9-af79-8af46cbcb0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.556928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af486c6-45af-4ba9-af79-8af46cbcb0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.557890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af486c6-45af-4ba9-af79-8af46cbcb0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:45.559901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af486c6-45af-4ba9-af79-8af46cbcb0f9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:45.590589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1019/2037] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:45 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:45.591792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e8278-c72b-4ff7-a4bc-b96471626c86 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:45.603597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e8278-c72b-4ff7-a4bc-b96471626c86 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:45.608425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c294a-9284-41a6-9d82-cccc654260d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:45.609155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c294a-9284-41a6-9d82-cccc654260d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.609498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c294a-9284-41a6-9d82-cccc654260d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.609856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c294a-9284-41a6-9d82-cccc654260d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.610578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c294a-9284-41a6-9d82-cccc654260d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:45.612413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c294a-9284-41a6-9d82-cccc654260d6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:45.623339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1019/2038] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:45.627100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af486c6-45af-4ba9-af79-8af46cbcb0f9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:45.640480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af486c6-45af-4ba9-af79-8af46cbcb0f9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:45.645399 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6185a-acdf-4bd7-9d0b-5e552d4b83d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:45.646083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6185a-acdf-4bd7-9d0b-5e552d4b83d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.646425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6185a-acdf-4bd7-9d0b-5e552d4b83d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.646845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6185a-acdf-4bd7-9d0b-5e552d4b83d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.647587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6185a-acdf-4bd7-9d0b-5e552d4b83d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:45.649876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6185a-acdf-4bd7-9d0b-5e552d4b83d6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:45.652460 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:45.666281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1020/2039] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:45.667540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c294a-9284-41a6-9d82-cccc654260d6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:45.677806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c294a-9284-41a6-9d82-cccc654260d6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:45.682824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1c63f-5050-4b47-ba6c-20f047e9b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:45.683479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1c63f-5050-4b47-ba6c-20f047e9b4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.683756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1c63f-5050-4b47-ba6c-20f047e9b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.684025 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1c63f-5050-4b47-ba6c-20f047e9b4fc admin admin] PATH_INFO: `/v3/projects/577fbc41bc29482f9f346ab4a31f4a99/users/9c6351ae09844bd1aba6b0dff3d6ae27/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.703043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1c63f-5050-4b47-ba6c-20f047e9b4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=577fbc41bc29482f9f346ab4a31f4a99, user_id=9c6351ae09844bd1aba6b0dff3d6ae27, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:45.705739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1c63f-5050-4b47-ba6c-20f047e9b4fc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:45.718756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1020/2040] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:45 2022] PUT /identity/v3/projects/577fbc41bc29482f9f346ab4a31f4a99/users/9c6351ae09844bd1aba6b0dff3d6ae27/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:45.723842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9459f-c76f-45eb-b6d8-e7b748e67097 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.724223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9459f-c76f-45eb-b6d8-e7b748e67097 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.724563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9459f-c76f-45eb-b6d8-e7b748e67097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.744279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-9be9459f-c76f-45eb-b6d8-e7b748e67097 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:45.745499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9be9459f-c76f-45eb-b6d8-e7b748e67097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:45.812997 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1021/2041] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:45.823180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1c63f-5050-4b47-ba6c-20f047e9b4fc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:45.825015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-39f1c63f-5050-4b47-ba6c-20f047e9b4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:45.853119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:45.897848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1c63f-5050-4b47-ba6c-20f047e9b4fc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:45.902059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4d8c9-006f-4da9-bdb0-997153be8f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:45.902859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4d8c9-006f-4da9-bdb0-997153be8f03 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.903264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4d8c9-006f-4da9-bdb0-997153be8f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.903543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4d8c9-006f-4da9-bdb0-997153be8f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.914319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4d8c9-006f-4da9-bdb0-997153be8f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:45.915815 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4d8c9-006f-4da9-bdb0-997153be8f03 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:45.925447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1021/2042] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:46.955104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d021-e1c7-428b-8b3f-aca5cb2e80f5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:46.955698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d021-e1c7-428b-8b3f-aca5cb2e80f5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:46.955698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d021-e1c7-428b-8b3f-aca5cb2e80f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:46.993512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-79b2d021-e1c7-428b-8b3f-aca5cb2e80f5 None None] MFA Rules not processed for user `9c6351ae09844bd1aba6b0dff3d6ae27`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:46.995131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-79b2d021-e1c7-428b-8b3f-aca5cb2e80f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:47.085405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1022/2043] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:47.098369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4d8c9-006f-4da9-bdb0-997153be8f03 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:47.100446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-25b4d8c9-006f-4da9-bdb0-997153be8f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:47.236967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4d8c9-006f-4da9-bdb0-997153be8f03 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:47.243521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c7a84-a1a7-402a-87eb-6b01f8193182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:47.244601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7a84-a1a7-402a-87eb-6b01f8193182 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:47.244903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7a84-a1a7-402a-87eb-6b01f8193182 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:47.245175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7a84-a1a7-402a-87eb-6b01f8193182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:47.265201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c7a84-a1a7-402a-87eb-6b01f8193182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:47.268829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c7a84-a1a7-402a-87eb-6b01f8193182 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:47.282519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1022/2044] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:48.743669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467ce0-6165-467e-ae65-60772cc8b73d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:48.744268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467ce0-6165-467e-ae65-60772cc8b73d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:48.744268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467ce0-6165-467e-ae65-60772cc8b73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:48.764872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f5467ce0-6165-467e-ae65-60772cc8b73d None None] MFA Rules not processed for user `9c6351ae09844bd1aba6b0dff3d6ae27`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:48.766234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f5467ce0-6165-467e-ae65-60772cc8b73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:48.773450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1023/2045] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:49.627533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c7a84-a1a7-402a-87eb-6b01f8193182 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:49.629079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-499c7a84-a1a7-402a-87eb-6b01f8193182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:49.645395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c7a84-a1a7-402a-87eb-6b01f8193182 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:49.652007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:49.652934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:49.653367 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:49.653864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] PATH_INFO: `/v3/users/e6d4b3249c4a47ea94436a821c4c5cfe` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:49.655361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d4b3249c4a47ea94436a821c4c5cfe)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:49.660050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:49.744393 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d4b3249c4a47ea94436a821c4c5cfe'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:49.745258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d4b3249c4a47ea94436a821c4c5cfe'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:49.763504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d4b3249c4a47ea94436a821c4c5cfe'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:49.764694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d4b3249c4a47ea94436a821c4c5cfe'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:49.781666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d4b3249c4a47ea94436a821c4c5cfe'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:49.811457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1023/2046] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:49 2022] DELETE /identity/v3/users/e6d4b3249c4a47ea94436a821c4c5cfe => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:49.816220 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f7c1c-f01a-496c-85da-1ea566dd552a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:49.816771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f7c1c-f01a-496c-85da-1ea566dd552a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:49.817177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f7c1c-f01a-496c-85da-1ea566dd552a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:49.844271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-336f7c1c-f01a-496c-85da-1ea566dd552a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:49.845985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-336f7c1c-f01a-496c-85da-1ea566dd552a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:49.961796 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1024/2047] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:49.973956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:49.977936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:50.057800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:50.075264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f65dd-7919-4c06-9e21-5c73319b38cb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:50.078899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c739a42-330b-4d67-a2c3-cd64df488004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:50.079556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739a42-330b-4d67-a2c3-cd64df488004 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:50.079837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739a42-330b-4d67-a2c3-cd64df488004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:50.080109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739a42-330b-4d67-a2c3-cd64df488004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:50.090794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c739a42-330b-4d67-a2c3-cd64df488004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:50.092489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c739a42-330b-4d67-a2c3-cd64df488004 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:50.103811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1024/2048] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:50.296235 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfd787-8bfe-4ef7-94cf-845bd37d9a03 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:50.296533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfd787-8bfe-4ef7-94cf-845bd37d9a03 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:50.296791 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfd787-8bfe-4ef7-94cf-845bd37d9a03 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:50.298490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1025/2049] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:50.308773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3f7df-9d45-4cdd-8a30-35f57b971943 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:50.309473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3f7df-9d45-4cdd-8a30-35f57b971943 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:50.309756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3f7df-9d45-4cdd-8a30-35f57b971943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:50.340364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cbf3f7df-9d45-4cdd-8a30-35f57b971943 None None] MFA Rules not processed for user `6a4030325cf0481ab634e253cfed9c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:50.355788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cbf3f7df-9d45-4cdd-8a30-35f57b971943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:50.400282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfd787-8bfe-4ef7-94cf-845bd37d9a03 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:50.402515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-63cfd787-8bfe-4ef7-94cf-845bd37d9a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:50.431617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfd787-8bfe-4ef7-94cf-845bd37d9a03 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:50.440452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:50.441695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:50.442286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:50.442751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] PATH_INFO: `/v3/users/89745e9f5689415ab763980f222fe682` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:50.444513 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=89745e9f5689415ab763980f222fe682)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:50.448067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:50.471054 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:50.480826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1025/2050] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:35:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:50.498087 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3f7df-9d45-4cdd-8a30-35f57b971943 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:50.502754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cbf3f7df-9d45-4cdd-8a30-35f57b971943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:50.523576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3f7df-9d45-4cdd-8a30-35f57b971943 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:50.536491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc4cd3-118c-4497-8202-fb988ad35f87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4030325cf0481ab634e253cfed9c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:50.538145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc4cd3-118c-4497-8202-fb988ad35f87 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:50.539292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89745e9f5689415ab763980f222fe682'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:50.540144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89745e9f5689415ab763980f222fe682'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:50.540258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc4cd3-118c-4497-8202-fb988ad35f87 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:50.540520 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc4cd3-118c-4497-8202-fb988ad35f87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:50.560134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc4cd3-118c-4497-8202-fb988ad35f87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:50.563223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc4cd3-118c-4497-8202-fb988ad35f87 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:50.564219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89745e9f5689415ab763980f222fe682'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:50.573836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89745e9f5689415ab763980f222fe682'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:50.574603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89745e9f5689415ab763980f222fe682'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:50.575970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1026/2051] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:50.582420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc4cd3-118c-4497-8202-fb988ad35f87 service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:50.583793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b8dc4cd3-118c-4497-8202-fb988ad35f87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:50.600101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc4cd3-118c-4497-8202-fb988ad35f87 service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:50.600240 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1026/2052] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:50 2022] DELETE /identity/v3/users/89745e9f5689415ab763980f222fe682 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:50.728415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:50.729126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:50.732859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:50.733203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] PATH_INFO: `/v3/projects/706ef12b2b3346028bac3f828980704e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:50.734581 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706ef12b2b3346028bac3f828980704e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:50.736642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:50.857836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706ef12b2b3346028bac3f828980704e', 'request_id': 'req-caad4041-eaed-46a8-b33b-5d7d777222f6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:50.889035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706ef12b2b3346028bac3f828980704e', 'request_id': 'req-caad4041-eaed-46a8-b33b-5d7d777222f6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:50.896062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:50.898899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:50.899956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706ef12b2b3346028bac3f828980704e', 'request_id': 'req-caad4041-eaed-46a8-b33b-5d7d777222f6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:50.902947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:50.921641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] The token cache is being invalidate because project 706ef12b2b3346028bac3f828980704e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:50.921853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f53fc-d338-4fd4-8daf-a96e5602f98f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:50.922047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:50.922710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:50.927881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1027/2053] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:50 2022] DELETE /identity/v3/projects/706ef12b2b3346028bac3f828980704e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:50.931396 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:50.937728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:51.006390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.007847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.010628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.015145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] PATH_INFO: `/v3/projects/17afe680a48e4bac8ba0f2bfc7b4eb87` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.018038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17afe680a48e4bac8ba0f2bfc7b4eb87)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.022078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.034800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad4041-eaed-46a8-b33b-5d7d777222f6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:51.040705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.041571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.041959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.042365 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] PATH_INFO: `/v3/users/85402b9097fe4cb6b2a47cb9da4ccb7c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.043977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85402b9097fe4cb6b2a47cb9da4ccb7c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.048165 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.091950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17afe680a48e4bac8ba0f2bfc7b4eb87', 'request_id': 'req-9ca5dcef-b7a2-45f3-bead-18b289332224'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.098090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17afe680a48e4bac8ba0f2bfc7b4eb87', 'request_id': 'req-9ca5dcef-b7a2-45f3-bead-18b289332224'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.102030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85402b9097fe4cb6b2a47cb9da4ccb7c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.102755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85402b9097fe4cb6b2a47cb9da4ccb7c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.104212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17afe680a48e4bac8ba0f2bfc7b4eb87', 'request_id': 'req-9ca5dcef-b7a2-45f3-bead-18b289332224'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.110721 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85402b9097fe4cb6b2a47cb9da4ccb7c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.111645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85402b9097fe4cb6b2a47cb9da4ccb7c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.120415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] The token cache is being invalidate because project 17afe680a48e4bac8ba0f2bfc7b4eb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:51.120693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.121345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.122916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1027/2054] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:50 2022] DELETE /identity/v3/projects/17afe680a48e4bac8ba0f2bfc7b4eb87 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:51.126498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:51.126610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c08bed43-8709-431c-9e06-ad05e7f97a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85402b9097fe4cb6b2a47cb9da4ccb7c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.126747 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:51.140792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1028/2055] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:50 2022] DELETE /identity/v3/users/85402b9097fe4cb6b2a47cb9da4ccb7c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:51.140792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f5826-4896-4f51-8e2f-37533a322a9a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.140792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f5826-4896-4f51-8e2f-37533a322a9a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.141127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f5826-4896-4f51-8e2f-37533a322a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.162054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-827f5826-4896-4f51-8e2f-37533a322a9a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:51.163457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-827f5826-4896-4f51-8e2f-37533a322a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:51.165404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:51.215622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5dcef-b7a2-45f3-bead-18b289332224 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:51.257484 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1029/2056] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:51.268133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661ed78-2538-405c-a019-9561b99dceef None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.268133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661ed78-2538-405c-a019-9561b99dceef None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.268133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661ed78-2538-405c-a019-9561b99dceef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.292539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.292539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.292539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.292539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] PATH_INFO: `/v3/users/b88a5fb265194297825ba74e6bdc512e` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.293606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88a5fb265194297825ba74e6bdc512e)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.294352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1661ed78-2538-405c-a019-9561b99dceef None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:51.295652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.296057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1661ed78-2538-405c-a019-9561b99dceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:51.322993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1030/2057] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:51.327588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661ed78-2538-405c-a019-9561b99dceef None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:51.340099 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661ed78-2538-405c-a019-9561b99dceef None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:51.345691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab78a1-2cd1-4b93-8792-d1ec5dd65195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.346182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab78a1-2cd1-4b93-8792-d1ec5dd65195 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.346509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab78a1-2cd1-4b93-8792-d1ec5dd65195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.346838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab78a1-2cd1-4b93-8792-d1ec5dd65195 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.347499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab78a1-2cd1-4b93-8792-d1ec5dd65195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:51.347803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab78a1-2cd1-4b93-8792-d1ec5dd65195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.349454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab78a1-2cd1-4b93-8792-d1ec5dd65195 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.351855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:51.364106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1031/2058] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:51.368696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab78a1-2cd1-4b93-8792-d1ec5dd65195 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:51.370386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88a5fb265194297825ba74e6bdc512e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.371159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88a5fb265194297825ba74e6bdc512e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.383059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab78a1-2cd1-4b93-8792-d1ec5dd65195 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:51.390168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe071e-a7a7-482e-9195-b750e3c31ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.390702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88a5fb265194297825ba74e6bdc512e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.391206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe071e-a7a7-482e-9195-b750e3c31ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.391904 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe071e-a7a7-482e-9195-b750e3c31ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.392332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe071e-a7a7-482e-9195-b750e3c31ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.393463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe071e-a7a7-482e-9195-b750e3c31ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.396341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe071e-a7a7-482e-9195-b750e3c31ea0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.399817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88a5fb265194297825ba74e6bdc512e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.401938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ea65556f-ce17-4c6e-af0d-cabc74853069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88a5fb265194297825ba74e6bdc512e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.428140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1028/2059] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:51 2022] DELETE /identity/v3/users/b88a5fb265194297825ba74e6bdc512e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:51.430444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2e71-3e2a-4b8a-8dd7-c30a1362a64c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.430818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2e71-3e2a-4b8a-8dd7-c30a1362a64c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.431088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2e71-3e2a-4b8a-8dd7-c30a1362a64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.452433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1032/2060] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:51 2022] POST /identity/v3/projects => generated 361 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:51.459171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe071e-a7a7-482e-9195-b750e3c31ea0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:51.459572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8b5b2e71-3e2a-4b8a-8dd7-c30a1362a64c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:51.461839 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8b5b2e71-3e2a-4b8a-8dd7-c30a1362a64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:51.464365 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-58fe071e-a7a7-482e-9195-b750e3c31ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:51.541501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:51.595273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe071e-a7a7-482e-9195-b750e3c31ea0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:51.603819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1029/2061] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:51.604003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b65fa-d5e0-4d2e-abd8-7a46dc82f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.604003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b65fa-d5e0-4d2e-abd8-7a46dc82f327 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.604003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b65fa-d5e0-4d2e-abd8-7a46dc82f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.604003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b65fa-d5e0-4d2e-abd8-7a46dc82f327 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.606700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b65fa-d5e0-4d2e-abd8-7a46dc82f327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.606700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b65fa-d5e0-4d2e-abd8-7a46dc82f327 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.614710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2e71-3e2a-4b8a-8dd7-c30a1362a64c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:51.614710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8b5b2e71-3e2a-4b8a-8dd7-c30a1362a64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:51.638859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1033/2062] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:51 2022] POST /identity/v3/users => generated 281 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:51.643154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b65fa-d5e0-4d2e-abd8-7a46dc82f327 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:51.661120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b65fa-d5e0-4d2e-abd8-7a46dc82f327 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:51.670174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79191c3d-df23-4403-9a73-69bbf83e086a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.670963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79191c3d-df23-4403-9a73-69bbf83e086a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.671175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79191c3d-df23-4403-9a73-69bbf83e086a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.671483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79191c3d-df23-4403-9a73-69bbf83e086a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.672107 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79191c3d-df23-4403-9a73-69bbf83e086a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.673748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79191c3d-df23-4403-9a73-69bbf83e086a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.690786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1034/2063] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:51.691976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79191c3d-df23-4403-9a73-69bbf83e086a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:51.695929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-79191c3d-df23-4403-9a73-69bbf83e086a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:51.713386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2e71-3e2a-4b8a-8dd7-c30a1362a64c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:51.714101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79191c3d-df23-4403-9a73-69bbf83e086a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:51.717319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fc3be-5911-4baa-9a0f-04b7de459a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.718053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc3be-5911-4baa-9a0f-04b7de459a41 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.718264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc3be-5911-4baa-9a0f-04b7de459a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.718539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc3be-5911-4baa-9a0f-04b7de459a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.720123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.720756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.721090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.721429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] PATH_INFO: `/v3/projects/4f11d5a8dc334ab686bc2c6c1140af1f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.722544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f11d5a8dc334ab686bc2c6c1140af1f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.725242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.734526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fc3be-5911-4baa-9a0f-04b7de459a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.736714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fc3be-5911-4baa-9a0f-04b7de459a41 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.748082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1030/2064] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:51.748767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fc3be-5911-4baa-9a0f-04b7de459a41 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:51.760847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fc3be-5911-4baa-9a0f-04b7de459a41 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:51.768220 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d114b-dd0a-4182-a990-f4d2402d9388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.768899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d114b-dd0a-4182-a990-f4d2402d9388 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.769199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d114b-dd0a-4182-a990-f4d2402d9388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.772171 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d114b-dd0a-4182-a990-f4d2402d9388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.773017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d114b-dd0a-4182-a990-f4d2402d9388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.774791 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d114b-dd0a-4182-a990-f4d2402d9388 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.798852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1031/2065] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:51.802523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d114b-dd0a-4182-a990-f4d2402d9388 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:51.811727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f11d5a8dc334ab686bc2c6c1140af1f', 'request_id': 'req-96507f7f-b182-4fb7-948a-eaf47bfe7216'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.814883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d114b-dd0a-4182-a990-f4d2402d9388 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:51.829380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f11d5a8dc334ab686bc2c6c1140af1f', 'request_id': 'req-96507f7f-b182-4fb7-948a-eaf47bfe7216'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.844254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f11d5a8dc334ab686bc2c6c1140af1f', 'request_id': 'req-96507f7f-b182-4fb7-948a-eaf47bfe7216'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.875281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] The token cache is being invalidate because project 4f11d5a8dc334ab686bc2c6c1140af1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:51.875635 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.876301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:51.878878 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1035/2066] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:51 2022] DELETE /identity/v3/projects/4f11d5a8dc334ab686bc2c6c1140af1f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:51.883609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:51.885200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:51.927848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c3198-7082-4339-93f7-13e9a065db3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:51.931141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c3198-7082-4339-93f7-13e9a065db3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.931433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c3198-7082-4339-93f7-13e9a065db3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.931809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c3198-7082-4339-93f7-13e9a065db3d admin admin] PATH_INFO: `/v3/projects/c211186f695e4832b15f1c6cbcef2098/users/2f2fc4323abd4dd0ab02a1c7f14227f4/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:51.953053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c3198-7082-4339-93f7-13e9a065db3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c211186f695e4832b15f1c6cbcef2098, user_id=2f2fc4323abd4dd0ab02a1c7f14227f4, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:51.955543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:51.958986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c3198-7082-4339-93f7-13e9a065db3d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:51.984873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1032/2067] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:51 2022] PUT /identity/v3/projects/c211186f695e4832b15f1c6cbcef2098/users/2f2fc4323abd4dd0ab02a1c7f14227f4/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:51.995987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae8f8-ea60-4759-88db-d95a90c2b636 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:51.996278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae8f8-ea60-4759-88db-d95a90c2b636 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:51.996554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae8f8-ea60-4759-88db-d95a90c2b636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:52.022042 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507f7f-b182-4fb7-948a-eaf47bfe7216 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:52.036366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1bbae8f8-ea60-4759-88db-d95a90c2b636 None None] MFA Rules not processed for user `2f2fc4323abd4dd0ab02a1c7f14227f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:52.037864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1bbae8f8-ea60-4759-88db-d95a90c2b636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:52.107827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:52.108371 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:52.108652 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:52.108926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] PATH_INFO: `/v3/users/17e834b71a084889bf2aa4186517a719` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:52.110095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e834b71a084889bf2aa4186517a719)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:52.112155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:52.176713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:52.221986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e834b71a084889bf2aa4186517a719'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.222826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e834b71a084889bf2aa4186517a719'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.223918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1033/2068] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:52.226473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbae8f8-ea60-4759-88db-d95a90c2b636 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:52.228551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1bbae8f8-ea60-4759-88db-d95a90c2b636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:52.232218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e834b71a084889bf2aa4186517a719'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.233015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e834b71a084889bf2aa4186517a719'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.254092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e834b71a084889bf2aa4186517a719'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.262270 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbae8f8-ea60-4759-88db-d95a90c2b636 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:52.267604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:52.268240 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:52.268521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:52.268795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] PATH_INFO: `/v3/projects/788f80cd759b4bfb9764f4d1c35e49bc` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:52.269914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] RBAC: Authorizing `identity:delete_project(project_id=788f80cd759b4bfb9764f4d1c35e49bc)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:52.271939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:52.274726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1036/2069] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:51 2022] DELETE /identity/v3/users/17e834b71a084889bf2aa4186517a719 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:52.279067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:52.280108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:52.348833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788f80cd759b4bfb9764f4d1c35e49bc', 'request_id': 'req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.359225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788f80cd759b4bfb9764f4d1c35e49bc', 'request_id': 'req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.368909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788f80cd759b4bfb9764f4d1c35e49bc', 'request_id': 'req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.386224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b393d-af18-4145-a9c2-00db344945a7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:52.390122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] The token cache is being invalidate because project 788f80cd759b4bfb9764f4d1c35e49bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:52.390122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.390754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.395220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:52.397022 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1034/2070] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:52 2022] DELETE /identity/v3/projects/788f80cd759b4bfb9764f4d1c35e49bc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:52.403176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:52.405908 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:52.496779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04986253-3bee-49a0-9863-8ee39a358ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:52.497717 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04986253-3bee-49a0-9863-8ee39a358ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:52.498160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04986253-3bee-49a0-9863-8ee39a358ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:52.498634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04986253-3bee-49a0-9863-8ee39a358ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:52.499440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04986253-3bee-49a0-9863-8ee39a358ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:52.502087 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04986253-3bee-49a0-9863-8ee39a358ec5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:52.511033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4ce70-8176-4d4b-8d7e-117eeddd859d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:52.516073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:52.516710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:52.517031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:52.517305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] PATH_INFO: `/v3/users/cf62f98248654ce68505f66368455f15` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:52.518454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf62f98248654ce68505f66368455f15)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:52.520504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:52.541244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1037/2071] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:52 2022] POST /identity/v3/projects => generated 363 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:52.546811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04986253-3bee-49a0-9863-8ee39a358ec5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:52.550382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-04986253-3bee-49a0-9863-8ee39a358ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:52.598471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf62f98248654ce68505f66368455f15'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.599277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf62f98248654ce68505f66368455f15'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.626235 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf62f98248654ce68505f66368455f15'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.635132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf62f98248654ce68505f66368455f15'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.637679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf62f98248654ce68505f66368455f15'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.667271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:52.672594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04986253-3bee-49a0-9863-8ee39a358ec5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:52.679985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1ea7e-693a-4171-a5da-54553aa2355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:52.680747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1ea7e-693a-4171-a5da-54553aa2355b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:52.682375 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1ea7e-693a-4171-a5da-54553aa2355b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:52.682695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1ea7e-693a-4171-a5da-54553aa2355b admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:52.683511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1ea7e-693a-4171-a5da-54553aa2355b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:52.685196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1035/2072] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:52 2022] DELETE /identity/v3/users/cf62f98248654ce68505f66368455f15 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:52.686043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:52.690019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:52.690993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1ea7e-693a-4171-a5da-54553aa2355b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:52.731368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1038/2073] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:52 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:52.735043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1ea7e-693a-4171-a5da-54553aa2355b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:52.748169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07b1ea7e-693a-4171-a5da-54553aa2355b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:52.763118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1ea7e-693a-4171-a5da-54553aa2355b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:52.808104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15348c48-b0a4-4aef-93ee-67e149ddebe7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:52.814518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:52.815740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:52.816116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:52.816531 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] PATH_INFO: `/v3/projects/b364766e0b244a16b7a515266264123b` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:52.818220 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b364766e0b244a16b7a515266264123b)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:52.821698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:52.839532 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e90a60-0031-4dbb-89d8-ee77ec459040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:52.840369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e90a60-0031-4dbb-89d8-ee77ec459040 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:52.840894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e90a60-0031-4dbb-89d8-ee77ec459040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:52.841333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e90a60-0031-4dbb-89d8-ee77ec459040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:52.841826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e90a60-0031-4dbb-89d8-ee77ec459040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:52.843616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e90a60-0031-4dbb-89d8-ee77ec459040 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:52.857081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1039/2074] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:52.861531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e90a60-0031-4dbb-89d8-ee77ec459040 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:52.877967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e90a60-0031-4dbb-89d8-ee77ec459040 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:52.901053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:52.907006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b364766e0b244a16b7a515266264123b', 'request_id': 'req-85753459-09b4-42b8-b9be-cd51b8863eaf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.916613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b364766e0b244a16b7a515266264123b', 'request_id': 'req-85753459-09b4-42b8-b9be-cd51b8863eaf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.929517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b364766e0b244a16b7a515266264123b', 'request_id': 'req-85753459-09b4-42b8-b9be-cd51b8863eaf'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.950224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] The token cache is being invalidate because project b364766e0b244a16b7a515266264123b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:52.950747 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.951521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-85753459-09b4-42b8-b9be-cd51b8863eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:52.953201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1036/2075] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:52 2022] DELETE /identity/v3/projects/b364766e0b244a16b7a515266264123b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:52.958092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d53a0-088e-4049-aeb9-8de948fb27d8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:52.958410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d53a0-088e-4049-aeb9-8de948fb27d8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:52.958854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d53a0-088e-4049-aeb9-8de948fb27d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:52.971146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c7b80-082c-4f00-a8f1-26ac1b3a3a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:52.971896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c7b80-082c-4f00-a8f1-26ac1b3a3a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:52.972180 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c7b80-082c-4f00-a8f1-26ac1b3a3a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:52.972453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c7b80-082c-4f00-a8f1-26ac1b3a3a51 admin admin] PATH_INFO: `/v3/projects/8fe9f92e060b4efd8cc1a49840331af0/users/671e679f0ef34deba15eb03a7e6609ba/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:52.988317 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-cc1d53a0-088e-4049-aeb9-8de948fb27d8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:52.989822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cc1d53a0-088e-4049-aeb9-8de948fb27d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:52.992716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c7b80-082c-4f00-a8f1-26ac1b3a3a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe9f92e060b4efd8cc1a49840331af0, user_id=671e679f0ef34deba15eb03a7e6609ba, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:52.995846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c7b80-082c-4f00-a8f1-26ac1b3a3a51 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.002444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1037/2076] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:53.011375 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cacba2-8e8d-422b-85a4-e51d4bc17dbf None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.011845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cacba2-8e8d-422b-85a4-e51d4bc17dbf None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.012222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cacba2-8e8d-422b-85a4-e51d4bc17dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.020905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1040/2077] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:52 2022] PUT /identity/v3/projects/8fe9f92e060b4efd8cc1a49840331af0/users/671e679f0ef34deba15eb03a7e6609ba/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:53.024305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c7b80-082c-4f00-a8f1-26ac1b3a3a51 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.027536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-122c7b80-082c-4f00-a8f1-26ac1b3a3a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:53.043998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-24cacba2-8e8d-422b-85a4-e51d4bc17dbf None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:53.046284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-24cacba2-8e8d-422b-85a4-e51d4bc17dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:53.118424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c7b80-082c-4f00-a8f1-26ac1b3a3a51 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.126538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583b9d4-2bb7-4191-ae01-7b6df3cc1ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.127318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583b9d4-2bb7-4191-ae01-7b6df3cc1ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.127669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583b9d4-2bb7-4191-ae01-7b6df3cc1ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.128007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583b9d4-2bb7-4191-ae01-7b6df3cc1ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.128731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583b9d4-2bb7-4191-ae01-7b6df3cc1ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.130443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583b9d4-2bb7-4191-ae01-7b6df3cc1ab9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.143351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1041/2078] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:53.148552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583b9d4-2bb7-4191-ae01-7b6df3cc1ab9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.150841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1038/2079] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:53.153426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cacba2-8e8d-422b-85a4-e51d4bc17dbf None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.165130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583b9d4-2bb7-4191-ae01-7b6df3cc1ab9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.167373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cacba2-8e8d-422b-85a4-e51d4bc17dbf None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.170438 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd87e5-8660-485b-99e0-09213e0a7ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.171211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd87e5-8660-485b-99e0-09213e0a7ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.171725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd87e5-8660-485b-99e0-09213e0a7ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.171947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd87e5-8660-485b-99e0-09213e0a7ec8 admin admin] PATH_INFO: `/v3/projects/8fe9f92e060b4efd8cc1a49840331af0/users/671e679f0ef34deba15eb03a7e6609ba/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.173513 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac6114-a427-4715-9502-3138d8b1a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.173929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd87e5-8660-485b-99e0-09213e0a7ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe9f92e060b4efd8cc1a49840331af0, user_id=671e679f0ef34deba15eb03a7e6609ba, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.174376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac6114-a427-4715-9502-3138d8b1a2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.175296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac6114-a427-4715-9502-3138d8b1a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.175296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac6114-a427-4715-9502-3138d8b1a2f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.176009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac6114-a427-4715-9502-3138d8b1a2f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:53.176431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac6114-a427-4715-9502-3138d8b1a2f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.176639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd87e5-8660-485b-99e0-09213e0a7ec8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.178281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac6114-a427-4715-9502-3138d8b1a2f9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.192805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1039/2081] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:53.197883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac6114-a427-4715-9502-3138d8b1a2f9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.199242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1042/2081] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:53 2022] PUT /identity/v3/projects/8fe9f92e060b4efd8cc1a49840331af0/users/671e679f0ef34deba15eb03a7e6609ba/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:53.200735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197f48-5032-4798-ae5d-ad98dd1a4ceb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.201021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197f48-5032-4798-ae5d-ad98dd1a4ceb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.201372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197f48-5032-4798-ae5d-ad98dd1a4ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.212152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac6114-a427-4715-9502-3138d8b1a2f9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.219974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:53.246725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9e197f48-5032-4798-ae5d-ad98dd1a4ceb None None] MFA Rules not processed for user `671e679f0ef34deba15eb03a7e6609ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:53.248196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e197f48-5032-4798-ae5d-ad98dd1a4ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:53.343778 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc452774-88f5-4ac8-a47c-37f1747e3ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.344624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc452774-88f5-4ac8-a47c-37f1747e3ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.345053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc452774-88f5-4ac8-a47c-37f1747e3ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.345477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc452774-88f5-4ac8-a47c-37f1747e3ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.346696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc452774-88f5-4ac8-a47c-37f1747e3ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.348944 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc452774-88f5-4ac8-a47c-37f1747e3ee0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.358982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1043/2082] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:53.358982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197f48-5032-4798-ae5d-ad98dd1a4ceb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.358982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e197f48-5032-4798-ae5d-ad98dd1a4ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:53.374764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197f48-5032-4798-ae5d-ad98dd1a4ceb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.380772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.381589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.382098 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.382380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] PATH_INFO: `/v3/projects/5fb84df538ef47668de1e5a934253efa` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.383781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb84df538ef47668de1e5a934253efa)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.385744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.388655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:53.403304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1040/2083] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:53 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:53.403304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc452774-88f5-4ac8-a47c-37f1747e3ee0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.405127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dc452774-88f5-4ac8-a47c-37f1747e3ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:53.448712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb84df538ef47668de1e5a934253efa', 'request_id': 'req-3c46c577-6657-4a46-9414-85643c5359e0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:53.463443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb84df538ef47668de1e5a934253efa', 'request_id': 'req-3c46c577-6657-4a46-9414-85643c5359e0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:53.477610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb84df538ef47668de1e5a934253efa', 'request_id': 'req-3c46c577-6657-4a46-9414-85643c5359e0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:53.488029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc452774-88f5-4ac8-a47c-37f1747e3ee0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.493897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] The token cache is being invalidate because project 5fb84df538ef47668de1e5a934253efa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:53.494189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:53.495165 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:53.496567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1044/2084] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:53 2022] DELETE /identity/v3/projects/5fb84df538ef47668de1e5a934253efa => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:53.500142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.501160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:53.551344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697b4a2-d65d-4abd-b590-e1c7903825ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.551961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b4a2-d65d-4abd-b590-e1c7903825ae service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.552239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b4a2-d65d-4abd-b590-e1c7903825ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.552882 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b4a2-d65d-4abd-b590-e1c7903825ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.555108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5697b4a2-d65d-4abd-b590-e1c7903825ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:53.582491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46c577-6657-4a46-9414-85643c5359e0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.590294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf350bee-01ed-4036-be6c-dee13def59ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.590932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf350bee-01ed-4036-be6c-dee13def59ed admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.591211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf350bee-01ed-4036-be6c-dee13def59ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.591771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf350bee-01ed-4036-be6c-dee13def59ed admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.592109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf350bee-01ed-4036-be6c-dee13def59ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.595450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf350bee-01ed-4036-be6c-dee13def59ed admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.623299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1045/2085] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:53 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:53.624747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652252b9-43fa-4bf5-a328-f3a261c0739f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.625206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652252b9-43fa-4bf5-a328-f3a261c0739f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.625627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652252b9-43fa-4bf5-a328-f3a261c0739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.636413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697b4a2-d65d-4abd-b590-e1c7903825ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.637865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697b4a2-d65d-4abd-b590-e1c7903825ae service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.643119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:53.645817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-652252b9-43fa-4bf5-a328-f3a261c0739f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:53.647130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-652252b9-43fa-4bf5-a328-f3a261c0739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:53.651017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1041/2086] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:53.651732 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697b4a2-d65d-4abd-b590-e1c7903825ae service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.664160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697b4a2-d65d-4abd-b590-e1c7903825ae service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.674401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1046/2087] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:53.674931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31ce34-6934-40a7-862a-cf4c2de72c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.674931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31ce34-6934-40a7-862a-cf4c2de72c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.674931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31ce34-6934-40a7-862a-cf4c2de72c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.674931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31ce34-6934-40a7-862a-cf4c2de72c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.675223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31ce34-6934-40a7-862a-cf4c2de72c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.675223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31ce34-6934-40a7-862a-cf4c2de72c3d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.681601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831a7e7-ffdd-47e7-bcdd-55941db47da6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.681890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831a7e7-ffdd-47e7-bcdd-55941db47da6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.682232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831a7e7-ffdd-47e7-bcdd-55941db47da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.686833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1042/2088] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:53.690911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31ce34-6934-40a7-862a-cf4c2de72c3d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.705632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31ce34-6934-40a7-862a-cf4c2de72c3d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.711480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e831a7e7-ffdd-47e7-bcdd-55941db47da6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:53.712885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e831a7e7-ffdd-47e7-bcdd-55941db47da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:53.713114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecc9fb-0244-4f69-acfe-f9348df01ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.714330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecc9fb-0244-4f69-acfe-f9348df01ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.714595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecc9fb-0244-4f69-acfe-f9348df01ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.715257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecc9fb-0244-4f69-acfe-f9348df01ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.715890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecc9fb-0244-4f69-acfe-f9348df01ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.717568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecc9fb-0244-4f69-acfe-f9348df01ca8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.722091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1047/2089] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:53.726627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831a7e7-ffdd-47e7-bcdd-55941db47da6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.733384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1043/2090] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:53.734454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecc9fb-0244-4f69-acfe-f9348df01ca8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.737283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831a7e7-ffdd-47e7-bcdd-55941db47da6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.744768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150d2aa-74ce-47ea-9212-c904ef24b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.745440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150d2aa-74ce-47ea-9212-c904ef24b2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.745657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150d2aa-74ce-47ea-9212-c904ef24b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.745866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecc9fb-0244-4f69-acfe-f9348df01ca8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.746075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150d2aa-74ce-47ea-9212-c904ef24b2e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.746860 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150d2aa-74ce-47ea-9212-c904ef24b2e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:53.747183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150d2aa-74ce-47ea-9212-c904ef24b2e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.750120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150d2aa-74ce-47ea-9212-c904ef24b2e9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.759059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0390b7-b41a-4607-b9c1-ba67dcc5b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.759637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0390b7-b41a-4607-b9c1-ba67dcc5b6df admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.759972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0390b7-b41a-4607-b9c1-ba67dcc5b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.760148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0390b7-b41a-4607-b9c1-ba67dcc5b6df admin admin] PATH_INFO: `/v3/projects/d8fbf6401fad4b75a7c3b3f1a1286785/users/82f95a795dc64d2eab783001bb807056/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.767595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1048/2091] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:53.771869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150d2aa-74ce-47ea-9212-c904ef24b2e9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.781782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0390b7-b41a-4607-b9c1-ba67dcc5b6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fbf6401fad4b75a7c3b3f1a1286785, user_id=82f95a795dc64d2eab783001bb807056, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.785597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0390b7-b41a-4607-b9c1-ba67dcc5b6df admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.785802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150d2aa-74ce-47ea-9212-c904ef24b2e9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.793282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa7be7-20df-46a1-b8f7-bab35c980295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.794108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa7be7-20df-46a1-b8f7-bab35c980295 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.794513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa7be7-20df-46a1-b8f7-bab35c980295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.794859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa7be7-20df-46a1-b8f7-bab35c980295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.796268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa7be7-20df-46a1-b8f7-bab35c980295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.799830 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa7be7-20df-46a1-b8f7-bab35c980295 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:53.807865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1044/2092] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:53 2022] PUT /identity/v3/projects/d8fbf6401fad4b75a7c3b3f1a1286785/users/82f95a795dc64d2eab783001bb807056/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:53.819904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9054-dfa6-4f9f-ae0c-b8b1092c8bdd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.821289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9054-dfa6-4f9f-ae0c-b8b1092c8bdd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.821871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9054-dfa6-4f9f-ae0c-b8b1092c8bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.841980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1049/2093] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:53 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:53.851402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa7be7-20df-46a1-b8f7-bab35c980295 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:53.883937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fd8b9054-dfa6-4f9f-ae0c-b8b1092c8bdd None None] MFA Rules not processed for user `82f95a795dc64d2eab783001bb807056`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:53.896464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fd8b9054-dfa6-4f9f-ae0c-b8b1092c8bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:53.919835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:53.967161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa7be7-20df-46a1-b8f7-bab35c980295 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:53.972591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407547d-1ea0-444d-8cd8-3ab6d294bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:53.973370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407547d-1ea0-444d-8cd8-3ab6d294bf74 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:53.973712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407547d-1ea0-444d-8cd8-3ab6d294bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:53.974051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407547d-1ea0-444d-8cd8-3ab6d294bf74 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:53.974981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407547d-1ea0-444d-8cd8-3ab6d294bf74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:53.977954 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407547d-1ea0-444d-8cd8-3ab6d294bf74 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.000764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1045/2094] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:54.007776 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b9054-dfa6-4f9f-ae0c-b8b1092c8bdd None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.023254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b9054-dfa6-4f9f-ae0c-b8b1092c8bdd None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.035954 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cb5ee-e4b4-439e-8bcc-9a34ef8896a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.040103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1050/2095] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:53 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:54.041712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407547d-1ea0-444d-8cd8-3ab6d294bf74 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.042076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cb5ee-e4b4-439e-8bcc-9a34ef8896a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.042902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cb5ee-e4b4-439e-8bcc-9a34ef8896a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.043380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cb5ee-e4b4-439e-8bcc-9a34ef8896a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.045095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cb5ee-e4b4-439e-8bcc-9a34ef8896a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.048474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cb5ee-e4b4-439e-8bcc-9a34ef8896a6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.058430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407547d-1ea0-444d-8cd8-3ab6d294bf74 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.066062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d361-2ad8-4fc7-bbf5-d55c6438cf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.066710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d361-2ad8-4fc7-bbf5-d55c6438cf6e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.066990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d361-2ad8-4fc7-bbf5-d55c6438cf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.067265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d361-2ad8-4fc7-bbf5-d55c6438cf6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.067916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8d361-2ad8-4fc7-bbf5-d55c6438cf6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.070079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8d361-2ad8-4fc7-bbf5-d55c6438cf6e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.084552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1051/2096] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:54.089411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d361-2ad8-4fc7-bbf5-d55c6438cf6e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.095059 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1046/2097] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:54 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:54.096394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cb5ee-e4b4-439e-8bcc-9a34ef8896a6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.113784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d361-2ad8-4fc7-bbf5-d55c6438cf6e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.189404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683182a-6030-47ed-9d1d-8cee44e6d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.190212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683182a-6030-47ed-9d1d-8cee44e6d436 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.190584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683182a-6030-47ed-9d1d-8cee44e6d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.191070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683182a-6030-47ed-9d1d-8cee44e6d436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.191780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683182a-6030-47ed-9d1d-8cee44e6d436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.193566 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cb5ee-e4b4-439e-8bcc-9a34ef8896a6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.193670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683182a-6030-47ed-9d1d-8cee44e6d436 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.203909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789dda-6b00-4ddd-8a94-2db4d102b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.204813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789dda-6b00-4ddd-8a94-2db4d102b497 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.205325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789dda-6b00-4ddd-8a94-2db4d102b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.205611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789dda-6b00-4ddd-8a94-2db4d102b497 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.206264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789dda-6b00-4ddd-8a94-2db4d102b497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.208225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789dda-6b00-4ddd-8a94-2db4d102b497 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.212606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1052/2098] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:54.213782 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683182a-6030-47ed-9d1d-8cee44e6d436 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.226381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683182a-6030-47ed-9d1d-8cee44e6d436 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.232920 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8532dc7-6f5a-4e84-9c95-afba06f90b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.233659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8532dc7-6f5a-4e84-9c95-afba06f90b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.233961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8532dc7-6f5a-4e84-9c95-afba06f90b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.234233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8532dc7-6f5a-4e84-9c95-afba06f90b56 admin admin] PATH_INFO: `/v3/projects/de0c2ef6993d4a50b2a1da9d4a7313f4/users/c57954e8c1234f7ca93855fa3920ed9f/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.250005 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1047/2099] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:54 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:54.251551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789dda-6b00-4ddd-8a94-2db4d102b497 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.253399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8532dc7-6f5a-4e84-9c95-afba06f90b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0c2ef6993d4a50b2a1da9d4a7313f4, user_id=c57954e8c1234f7ca93855fa3920ed9f, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.256296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8532dc7-6f5a-4e84-9c95-afba06f90b56 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.263990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789dda-6b00-4ddd-8a94-2db4d102b497 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.271202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a5e98-cd4c-4256-a32f-a508b1b16d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.271947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a5e98-cd4c-4256-a32f-a508b1b16d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.272292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a5e98-cd4c-4256-a32f-a508b1b16d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.272999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a5e98-cd4c-4256-a32f-a508b1b16d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.273797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a5e98-cd4c-4256-a32f-a508b1b16d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.277789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1053/2100] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:54 2022] PUT /identity/v3/projects/de0c2ef6993d4a50b2a1da9d4a7313f4/users/c57954e8c1234f7ca93855fa3920ed9f/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:54.279628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8532dc7-6f5a-4e84-9c95-afba06f90b56 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.279859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a5e98-cd4c-4256-a32f-a508b1b16d1e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.281863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b8532dc7-6f5a-4e84-9c95-afba06f90b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:54.286659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:54.292975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1048/2101] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:54.294479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edb19f-c83c-4aba-ad55-f932ad595f8b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.295011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edb19f-c83c-4aba-ad55-f932ad595f8b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.295816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edb19f-c83c-4aba-ad55-f932ad595f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.328888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-08edb19f-c83c-4aba-ad55-f932ad595f8b None None] MFA Rules not processed for user `c57954e8c1234f7ca93855fa3920ed9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:54.330110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-08edb19f-c83c-4aba-ad55-f932ad595f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:54.353949 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8532dc7-6f5a-4e84-9c95-afba06f90b56 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.359579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.360220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.360835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.361244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] PATH_INFO: `/v3/users/2f2fc4323abd4dd0ab02a1c7f14227f4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.362430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2fc4323abd4dd0ab02a1c7f14227f4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.365086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.402162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:54.410182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1049/2102] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:54.415170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edb19f-c83c-4aba-ad55-f932ad595f8b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.426083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edb19f-c83c-4aba-ad55-f932ad595f8b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.427062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2fc4323abd4dd0ab02a1c7f14227f4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:54.427732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2fc4323abd4dd0ab02a1c7f14227f4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:54.433635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edccb2-886e-499f-b938-d53c721b9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.434237 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edccb2-886e-499f-b938-d53c721b9491 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.434511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edccb2-886e-499f-b938-d53c721b9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.434809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edccb2-886e-499f-b938-d53c721b9491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.435452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edccb2-886e-499f-b938-d53c721b9491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.436462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2fc4323abd4dd0ab02a1c7f14227f4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:54.437041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edccb2-886e-499f-b938-d53c721b9491 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.437339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2fc4323abd4dd0ab02a1c7f14227f4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:54.451396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1050/2103] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:54.451396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edccb2-886e-499f-b938-d53c721b9491 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.453414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2fc4323abd4dd0ab02a1c7f14227f4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:54.458186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f2edccb2-886e-499f-b938-d53c721b9491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:54.476023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1054/2104] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:54 2022] DELETE /identity/v3/users/2f2fc4323abd4dd0ab02a1c7f14227f4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:54.476727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edccb2-886e-499f-b938-d53c721b9491 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.479482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.480967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:54.544517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492927af-ff35-4ccd-a5d8-cd36c456dcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.545219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492927af-ff35-4ccd-a5d8-cd36c456dcbc admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.545503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492927af-ff35-4ccd-a5d8-cd36c456dcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.545771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492927af-ff35-4ccd-a5d8-cd36c456dcbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.546403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492927af-ff35-4ccd-a5d8-cd36c456dcbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.548421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492927af-ff35-4ccd-a5d8-cd36c456dcbc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.556703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c4d64-4b6e-4a8d-a325-8c2520d0dab9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.561406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cab05-b5a7-4ff5-8634-365174a62419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.562093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cab05-b5a7-4ff5-8634-365174a62419 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.562374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cab05-b5a7-4ff5-8634-365174a62419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.562649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cab05-b5a7-4ff5-8634-365174a62419 admin admin] PATH_INFO: `/v3/projects/c3956ecb45484061aac8703d3fe46882/users/5fe03d6ada1a48a7b63409a501dbc925/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.577643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1051/2105] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:54 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:54.579192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cab05-b5a7-4ff5-8634-365174a62419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3956ecb45484061aac8703d3fe46882, user_id=5fe03d6ada1a48a7b63409a501dbc925, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.580195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf8877-c1dc-4c60-98c9-12834d57823b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.580487 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf8877-c1dc-4c60-98c9-12834d57823b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.580763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf8877-c1dc-4c60-98c9-12834d57823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.581958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cab05-b5a7-4ff5-8634-365174a62419 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.595831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1055/2106] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:54 2022] PUT /identity/v3/projects/c3956ecb45484061aac8703d3fe46882/users/5fe03d6ada1a48a7b63409a501dbc925/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:54.596622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cab05-b5a7-4ff5-8634-365174a62419 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.603458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-81cf8877-c1dc-4c60-98c9-12834d57823b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:54.605057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-81cf8877-c1dc-4c60-98c9-12834d57823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:54.658582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cab05-b5a7-4ff5-8634-365174a62419 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.662857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1052/2107] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:54.663395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2cdd3-4cbf-418d-8439-14f86b63f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.663986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26f42a-b649-4ac9-93e6-8aafaa055c54 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.664148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2cdd3-4cbf-418d-8439-14f86b63f8af admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.664266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26f42a-b649-4ac9-93e6-8aafaa055c54 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.664428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2cdd3-4cbf-418d-8439-14f86b63f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.664539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26f42a-b649-4ac9-93e6-8aafaa055c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.664699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2cdd3-4cbf-418d-8439-14f86b63f8af admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.665324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2cdd3-4cbf-418d-8439-14f86b63f8af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.668045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2cdd3-4cbf-418d-8439-14f86b63f8af admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.674492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:54.689777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1056/2108] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:54 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:54.691066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2cdd3-4cbf-418d-8439-14f86b63f8af admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.694091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7fd2cdd3-4cbf-418d-8439-14f86b63f8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:54.695946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fa26f42a-b649-4ac9-93e6-8aafaa055c54 None None] MFA Rules not processed for user `5fe03d6ada1a48a7b63409a501dbc925`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:54.697148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fa26f42a-b649-4ac9-93e6-8aafaa055c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:54.712571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:54.752896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2cdd3-4cbf-418d-8439-14f86b63f8af admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.756479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb92bb-d0aa-4f93-9255-e6a00d1d9850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.757597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb92bb-d0aa-4f93-9255-e6a00d1d9850 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.757873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb92bb-d0aa-4f93-9255-e6a00d1d9850 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.758144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb92bb-d0aa-4f93-9255-e6a00d1d9850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.763532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1053/2109] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:54.764529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26f42a-b649-4ac9-93e6-8aafaa055c54 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.767235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb92bb-d0aa-4f93-9255-e6a00d1d9850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.768665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb92bb-d0aa-4f93-9255-e6a00d1d9850 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.778568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26f42a-b649-4ac9-93e6-8aafaa055c54 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.778888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1057/2110] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:54.780267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb92bb-d0aa-4f93-9255-e6a00d1d9850 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.783713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42be48-e2bf-4b09-9f0d-fc68fca86def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.784348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42be48-e2bf-4b09-9f0d-fc68fca86def admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.784625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42be48-e2bf-4b09-9f0d-fc68fca86def admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.785105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42be48-e2bf-4b09-9f0d-fc68fca86def admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.785756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42be48-e2bf-4b09-9f0d-fc68fca86def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.788047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42be48-e2bf-4b09-9f0d-fc68fca86def admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.789872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb92bb-d0aa-4f93-9255-e6a00d1d9850 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.794759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc988b8-6723-4452-abcb-2d8d2ddefc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.795427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc988b8-6723-4452-abcb-2d8d2ddefc01 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.795769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc988b8-6723-4452-abcb-2d8d2ddefc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.796115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc988b8-6723-4452-abcb-2d8d2ddefc01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.796807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc988b8-6723-4452-abcb-2d8d2ddefc01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.798542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1054/2111] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:54.798909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc988b8-6723-4452-abcb-2d8d2ddefc01 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.802571 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42be48-e2bf-4b09-9f0d-fc68fca86def admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.813587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42be48-e2bf-4b09-9f0d-fc68fca86def admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.818550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbd491-371d-4020-bad5-ccb6e857e831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.819773 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd491-371d-4020-bad5-ccb6e857e831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.820216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd491-371d-4020-bad5-ccb6e857e831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.820461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd491-371d-4020-bad5-ccb6e857e831 admin admin] PATH_INFO: `/v3/projects/bf12f0e4b67a4de88e0f796928ed7df1/users/3b198145780f440a8346169b9e10bbfb/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.833254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1058/2112] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:54 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:54.834782 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc988b8-6723-4452-abcb-2d8d2ddefc01 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.841029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbd491-371d-4020-bad5-ccb6e857e831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf12f0e4b67a4de88e0f796928ed7df1, user_id=3b198145780f440a8346169b9e10bbfb, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.843820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbd491-371d-4020-bad5-ccb6e857e831 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:54.859262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1055/2113] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:54 2022] PUT /identity/v3/projects/bf12f0e4b67a4de88e0f796928ed7df1/users/3b198145780f440a8346169b9e10bbfb/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:54.862831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbd491-371d-4020-bad5-ccb6e857e831 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:54.951838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc988b8-6723-4452-abcb-2d8d2ddefc01 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.988348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbd491-371d-4020-bad5-ccb6e857e831 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:54.994765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b617-1679-48d1-89af-65eac6fbbfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:54.995385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b617-1679-48d1-89af-65eac6fbbfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:54.996861 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b617-1679-48d1-89af-65eac6fbbfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:54.997155 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b617-1679-48d1-89af-65eac6fbbfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:54.997815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41b617-1679-48d1-89af-65eac6fbbfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:54.999767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41b617-1679-48d1-89af-65eac6fbbfa1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.013878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1056/2114] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:55.017523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b617-1679-48d1-89af-65eac6fbbfa1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:55.020094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cbd1c-a0af-4323-8d3b-fe3a97702064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.020966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cbd1c-a0af-4323-8d3b-fe3a97702064 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.021446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cbd1c-a0af-4323-8d3b-fe3a97702064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.021936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cbd1c-a0af-4323-8d3b-fe3a97702064 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.023391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cbd1c-a0af-4323-8d3b-fe3a97702064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:55.025518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cbd1c-a0af-4323-8d3b-fe3a97702064 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.031265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b617-1679-48d1-89af-65eac6fbbfa1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:55.037808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30f65d-f42b-4835-b36f-ae3eddbbe169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.039054 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30f65d-f42b-4835-b36f-ae3eddbbe169 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.039336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30f65d-f42b-4835-b36f-ae3eddbbe169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.039608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30f65d-f42b-4835-b36f-ae3eddbbe169 admin admin] PATH_INFO: `/v3/projects/bf12f0e4b67a4de88e0f796928ed7df1/users/3b198145780f440a8346169b9e10bbfb/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.041603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30f65d-f42b-4835-b36f-ae3eddbbe169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf12f0e4b67a4de88e0f796928ed7df1, user_id=3b198145780f440a8346169b9e10bbfb, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:55.044664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30f65d-f42b-4835-b36f-ae3eddbbe169 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.056273 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1057/2115] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:55 2022] PUT /identity/v3/projects/bf12f0e4b67a4de88e0f796928ed7df1/users/3b198145780f440a8346169b9e10bbfb/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:55.056642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1059/2116] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:54 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:55.060304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30f65d-f42b-4835-b36f-ae3eddbbe169 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:55.071135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652b72b-e137-467b-86d8-17f89ea4657f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.071575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652b72b-e137-467b-86d8-17f89ea4657f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.071999 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652b72b-e137-467b-86d8-17f89ea4657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.105637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c652b72b-e137-467b-86d8-17f89ea4657f None None] MFA Rules not processed for user `3b198145780f440a8346169b9e10bbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:55.107826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c652b72b-e137-467b-86d8-17f89ea4657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:55.127699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:55.132681 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:55.151914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30f65d-f42b-4835-b36f-ae3eddbbe169 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:55.158186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c890f5-43d4-457b-9cbc-86c9c69fab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.158984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c890f5-43d4-457b-9cbc-86c9c69fab76 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.159633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c890f5-43d4-457b-9cbc-86c9c69fab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.160056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c890f5-43d4-457b-9cbc-86c9c69fab76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.160717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c890f5-43d4-457b-9cbc-86c9c69fab76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:55.162560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c890f5-43d4-457b-9cbc-86c9c69fab76 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.174230 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1058/2117] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:55.178319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c890f5-43d4-457b-9cbc-86c9c69fab76 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:55.188569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c890f5-43d4-457b-9cbc-86c9c69fab76 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:55.193865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e84e4b-6fe4-48e7-a6d9-790ae730baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.194570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e84e4b-6fe4-48e7-a6d9-790ae730baa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.194875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e84e4b-6fe4-48e7-a6d9-790ae730baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.195143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e84e4b-6fe4-48e7-a6d9-790ae730baa6 admin admin] PATH_INFO: `/v3/projects/2d95ab48f7214c6788c6dc2b18856f37/users/2cb5158ca2b14dc28365ecc289f5687a/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.206987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1060/2118] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:55.212313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e84e4b-6fe4-48e7-a6d9-790ae730baa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d95ab48f7214c6788c6dc2b18856f37, user_id=2cb5158ca2b14dc28365ecc289f5687a, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:55.215996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e84e4b-6fe4-48e7-a6d9-790ae730baa6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.220353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652b72b-e137-467b-86d8-17f89ea4657f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:55.223888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c652b72b-e137-467b-86d8-17f89ea4657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:55.233129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1059/2119] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:55 2022] PUT /identity/v3/projects/2d95ab48f7214c6788c6dc2b18856f37/users/2cb5158ca2b14dc28365ecc289f5687a/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:55.237130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e84e4b-6fe4-48e7-a6d9-790ae730baa6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:55.336330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652b72b-e137-467b-86d8-17f89ea4657f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:55.345698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e84e4b-6fe4-48e7-a6d9-790ae730baa6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:55.353774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9415844-7213-4272-9e6b-f24f5cfff839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.354493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9415844-7213-4272-9e6b-f24f5cfff839 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.354833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9415844-7213-4272-9e6b-f24f5cfff839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.355114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9415844-7213-4272-9e6b-f24f5cfff839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.355766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9415844-7213-4272-9e6b-f24f5cfff839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:55.357436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9415844-7213-4272-9e6b-f24f5cfff839 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.368566 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1060/2120] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:55.372470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9415844-7213-4272-9e6b-f24f5cfff839 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:55.374310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b9415844-7213-4272-9e6b-f24f5cfff839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:55.389591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9415844-7213-4272-9e6b-f24f5cfff839 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:55.392324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4442785-cc84-4b9c-b169-a3a493608f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.392943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4442785-cc84-4b9c-b169-a3a493608f7e service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.393221 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4442785-cc84-4b9c-b169-a3a493608f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.393490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4442785-cc84-4b9c-b169-a3a493608f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.394878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.395500 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.395782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.396060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] PATH_INFO: `/v3/projects/c211186f695e4832b15f1c6cbcef2098` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.397180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c211186f695e4832b15f1c6cbcef2098)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:55.400264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.448523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c211186f695e4832b15f1c6cbcef2098', 'request_id': 'req-4f5186d5-3451-4654-9316-2859d5345625'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:55.456083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c211186f695e4832b15f1c6cbcef2098', 'request_id': 'req-4f5186d5-3451-4654-9316-2859d5345625'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:55.457254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4442785-cc84-4b9c-b169-a3a493608f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:55.458734 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4442785-cc84-4b9c-b169-a3a493608f7e service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.464559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c211186f695e4832b15f1c6cbcef2098', 'request_id': 'req-4f5186d5-3451-4654-9316-2859d5345625'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:55.469229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1061/2121] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:55.471594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4442785-cc84-4b9c-b169-a3a493608f7e service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:55.486158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4442785-cc84-4b9c-b169-a3a493608f7e service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:55.487224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] The token cache is being invalidate because project c211186f695e4832b15f1c6cbcef2098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:55.487681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:55.488639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:55.491280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1061/2122] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:55 2022] DELETE /identity/v3/projects/c211186f695e4832b15f1c6cbcef2098 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:55.496029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:55.498898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:55.512015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:55.548943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:55.562526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd88a6-6b6b-48f0-809c-2b759b97f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.562526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd88a6-6b6b-48f0-809c-2b759b97f9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.562764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd88a6-6b6b-48f0-809c-2b759b97f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.563043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd88a6-6b6b-48f0-809c-2b759b97f9c8 admin admin] PATH_INFO: `/v3/projects/2d95ab48f7214c6788c6dc2b18856f37/users/2cb5158ca2b14dc28365ecc289f5687a/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.565054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd88a6-6b6b-48f0-809c-2b759b97f9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d95ab48f7214c6788c6dc2b18856f37, user_id=2cb5158ca2b14dc28365ecc289f5687a, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:55.567797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd88a6-6b6b-48f0-809c-2b759b97f9c8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.579847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1062/2123] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:55 2022] PUT /identity/v3/projects/2d95ab48f7214c6788c6dc2b18856f37/users/2cb5158ca2b14dc28365ecc289f5687a/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:55.580654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd88a6-6b6b-48f0-809c-2b759b97f9c8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:55.582197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6bcd88a6-6b6b-48f0-809c-2b759b97f9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:55.590636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5186d5-3451-4654-9316-2859d5345625 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:55.642354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd88a6-6b6b-48f0-809c-2b759b97f9c8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:55.646293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55c99c-be2b-4c5b-9813-b805657915ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.646889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c99c-be2b-4c5b-9813-b805657915ea service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.647165 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c99c-be2b-4c5b-9813-b805657915ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.648002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c99c-be2b-4c5b-9813-b805657915ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.650003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8e55c99c-be2b-4c5b-9813-b805657915ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:55.650162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.650843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.651126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.651401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] PATH_INFO: `/v3/users/671e679f0ef34deba15eb03a7e6609ba` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.652586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=671e679f0ef34deba15eb03a7e6609ba)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:55.654492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.701337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671e679f0ef34deba15eb03a7e6609ba'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:55.701931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671e679f0ef34deba15eb03a7e6609ba'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:55.712477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55c99c-be2b-4c5b-9813-b805657915ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:55.713976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55c99c-be2b-4c5b-9813-b805657915ea service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:55.719327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671e679f0ef34deba15eb03a7e6609ba'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:55.724189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1063/2124] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:55.725844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7f71-1ab0-4fac-94e8-367e9355fe06 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.726238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7f71-1ab0-4fac-94e8-367e9355fe06 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.726553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7f71-1ab0-4fac-94e8-367e9355fe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.727425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671e679f0ef34deba15eb03a7e6609ba'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:55.728135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671e679f0ef34deba15eb03a7e6609ba'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:55.743567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1062/2125] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:55 2022] DELETE /identity/v3/users/671e679f0ef34deba15eb03a7e6609ba => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:55.763612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-536f7f71-1ab0-4fac-94e8-367e9355fe06 None None] MFA Rules not processed for user `2cb5158ca2b14dc28365ecc289f5687a`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:55.764871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-536f7f71-1ab0-4fac-94e8-367e9355fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:55.842931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:55.854742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1064/2126] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:55.864290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:55.865707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:55.937156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b7df-fb8a-4e8b-b0bd-16240fb19f9d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:55.941284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c92efa-6748-4f74-918c-ae13ea500ff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:55.941695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c92efa-6748-4f74-918c-ae13ea500ff6 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:55.941957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c92efa-6748-4f74-918c-ae13ea500ff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:55.942225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c92efa-6748-4f74-918c-ae13ea500ff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:55.943980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-21c92efa-6748-4f74-918c-ae13ea500ff6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:55.962265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:56.059428 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c92efa-6748-4f74-918c-ae13ea500ff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:56.060888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c92efa-6748-4f74-918c-ae13ea500ff6 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:56.071484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1063/2127] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:56.195361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7f71-1ab0-4fac-94e8-367e9355fe06 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:56.196970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-536f7f71-1ab0-4fac-94e8-367e9355fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:56.308253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7f71-1ab0-4fac-94e8-367e9355fe06 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:56.314942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:56.315591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:56.316028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:56.316446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] PATH_INFO: `/v3/projects/8fe9f92e060b4efd8cc1a49840331af0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:56.317970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe9f92e060b4efd8cc1a49840331af0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:56.320571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:56.405193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe9f92e060b4efd8cc1a49840331af0', 'request_id': 'req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:56.414525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe9f92e060b4efd8cc1a49840331af0', 'request_id': 'req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:56.421577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe9f92e060b4efd8cc1a49840331af0', 'request_id': 'req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:56.440331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] The token cache is being invalidate because project 8fe9f92e060b4efd8cc1a49840331af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:56.440832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:56.441523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ed290a3-bb8e-4ce8-b61d-05765b9d2b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:56.443573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1065/2128] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:56 2022] DELETE /identity/v3/projects/8fe9f92e060b4efd8cc1a49840331af0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:56.450189 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ba64-c468-4d19-9133-d9e618ed0a74 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:56.450612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ba64-c468-4d19-9133-d9e618ed0a74 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:56.451650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ba64-c468-4d19-9133-d9e618ed0a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:56.497424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d985ba64-c468-4d19-9133-d9e618ed0a74 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:56.498840 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d985ba64-c468-4d19-9133-d9e618ed0a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:56.618210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1064/2129] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:56.626324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff5d0a-993a-403b-b751-b200f4546e89 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:56.626324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff5d0a-993a-403b-b751-b200f4546e89 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:56.626324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff5d0a-993a-403b-b751-b200f4546e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:56.651125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-04ff5d0a-993a-403b-b751-b200f4546e89 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:56.652493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-04ff5d0a-993a-403b-b751-b200f4546e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:56.662366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1066/2130] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:56.667699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ba64-c468-4d19-9133-d9e618ed0a74 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:56.679358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ba64-c468-4d19-9133-d9e618ed0a74 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:56.685147 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b40354-e58e-4fe9-b5ee-879f42690719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:56.685972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b40354-e58e-4fe9-b5ee-879f42690719 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:56.686255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b40354-e58e-4fe9-b5ee-879f42690719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:56.686525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b40354-e58e-4fe9-b5ee-879f42690719 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:56.687207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b40354-e58e-4fe9-b5ee-879f42690719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:56.687539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b40354-e58e-4fe9-b5ee-879f42690719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:56.689137 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b40354-e58e-4fe9-b5ee-879f42690719 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:56.707959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1065/2131] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:56.709065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff5d0a-993a-403b-b751-b200f4546e89 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:56.719366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff5d0a-993a-403b-b751-b200f4546e89 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:56.724210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f12be1-d916-4bfd-8e27-cbd14316e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:56.724805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f12be1-d916-4bfd-8e27-cbd14316e276 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:56.725091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f12be1-d916-4bfd-8e27-cbd14316e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:56.725422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f12be1-d916-4bfd-8e27-cbd14316e276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:56.726578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f12be1-d916-4bfd-8e27-cbd14316e276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:56.741789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f12be1-d916-4bfd-8e27-cbd14316e276 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:56.776966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1067/2132] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:56 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:56.781709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b40354-e58e-4fe9-b5ee-879f42690719 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:56.793194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b40354-e58e-4fe9-b5ee-879f42690719 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:56.850043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84432fa-f5b4-4584-957c-70f215fd522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:56.851295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84432fa-f5b4-4584-957c-70f215fd522e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:56.851599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84432fa-f5b4-4584-957c-70f215fd522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:56.851871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84432fa-f5b4-4584-957c-70f215fd522e admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:56.852544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84432fa-f5b4-4584-957c-70f215fd522e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:56.854445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84432fa-f5b4-4584-957c-70f215fd522e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:56.876479 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1066/2133] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:56 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:56.880829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f12be1-d916-4bfd-8e27-cbd14316e276 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:56.891677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f12be1-d916-4bfd-8e27-cbd14316e276 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:56.896383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b48c2-d7ab-4a3c-9e20-9d0e292108ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:56.896975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b48c2-d7ab-4a3c-9e20-9d0e292108ab admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:56.897843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b48c2-d7ab-4a3c-9e20-9d0e292108ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:56.898313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b48c2-d7ab-4a3c-9e20-9d0e292108ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:56.898991 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b48c2-d7ab-4a3c-9e20-9d0e292108ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:56.900701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b48c2-d7ab-4a3c-9e20-9d0e292108ab admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:56.911022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1068/2134] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:56.916494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84432fa-f5b4-4584-957c-70f215fd522e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:56.929541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84432fa-f5b4-4584-957c-70f215fd522e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:56.934511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfb70d-2f47-4961-b85f-de0c282d2a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:56.935193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb70d-2f47-4961-b85f-de0c282d2a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:56.935473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb70d-2f47-4961-b85f-de0c282d2a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:56.935740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb70d-2f47-4961-b85f-de0c282d2a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:56.936420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfb70d-2f47-4961-b85f-de0c282d2a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:56.938006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfb70d-2f47-4961-b85f-de0c282d2a2c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:56.949085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1067/2135] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:56.953300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b48c2-d7ab-4a3c-9e20-9d0e292108ab admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:56.964062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b48c2-d7ab-4a3c-9e20-9d0e292108ab admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:56.968913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21578b-e8d7-40ba-858e-0886e8a9b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:56.969635 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21578b-e8d7-40ba-858e-0886e8a9b79b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:56.969880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21578b-e8d7-40ba-858e-0886e8a9b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:56.970191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21578b-e8d7-40ba-858e-0886e8a9b79b admin admin] PATH_INFO: `/v3/projects/6695333e92bb49458403d43cd408e876/users/a9d7a390e4b84b51b6d78b844cf41ce5/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:56.987609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21578b-e8d7-40ba-858e-0886e8a9b79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6695333e92bb49458403d43cd408e876, user_id=a9d7a390e4b84b51b6d78b844cf41ce5, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:56.990224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21578b-e8d7-40ba-858e-0886e8a9b79b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:57.002657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1069/2136] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:56 2022] PUT /identity/v3/projects/6695333e92bb49458403d43cd408e876/users/a9d7a390e4b84b51b6d78b844cf41ce5/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:57.013540 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7cad9-56f8-47b4-8d32-9d3405fa5f8e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.013830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7cad9-56f8-47b4-8d32-9d3405fa5f8e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.014102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7cad9-56f8-47b4-8d32-9d3405fa5f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.044216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a5e7cad9-56f8-47b4-8d32-9d3405fa5f8e None None] MFA Rules not processed for user `a9d7a390e4b84b51b6d78b844cf41ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:57.045417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a5e7cad9-56f8-47b4-8d32-9d3405fa5f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:57.053396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:57.108470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1068/2137] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:57.112947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21578b-e8d7-40ba-858e-0886e8a9b79b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:57.139884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:57.176375 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21578b-e8d7-40ba-858e-0886e8a9b79b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:57.181862 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3f7c9-662d-431c-bf36-f35956ac7878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:57.182464 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3f7c9-662d-431c-bf36-f35956ac7878 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.182780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3f7c9-662d-431c-bf36-f35956ac7878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.183059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3f7c9-662d-431c-bf36-f35956ac7878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.183707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3f7c9-662d-431c-bf36-f35956ac7878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:57.185597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3f7c9-662d-431c-bf36-f35956ac7878 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:57.211245 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1070/2138] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:57 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:57.216246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7cad9-56f8-47b4-8d32-9d3405fa5f8e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:57.229345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7cad9-56f8-47b4-8d32-9d3405fa5f8e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:57.292312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f17208-b6c7-4c61-90d0-836ea925c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:57.292921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17208-b6c7-4c61-90d0-836ea925c3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.293199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17208-b6c7-4c61-90d0-836ea925c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.293473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17208-b6c7-4c61-90d0-836ea925c3f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.294126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f17208-b6c7-4c61-90d0-836ea925c3f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:57.296132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f17208-b6c7-4c61-90d0-836ea925c3f1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:57.321153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1069/2139] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:57 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:57.322308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3f7c9-662d-431c-bf36-f35956ac7878 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:57.332402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3f7c9-662d-431c-bf36-f35956ac7878 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:57.337282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8576c-b5bc-4e49-9a2c-55b35b45fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:57.337877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8576c-b5bc-4e49-9a2c-55b35b45fb67 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.338153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8576c-b5bc-4e49-9a2c-55b35b45fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.338419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8576c-b5bc-4e49-9a2c-55b35b45fb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.339091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8576c-b5bc-4e49-9a2c-55b35b45fb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:57.340676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8576c-b5bc-4e49-9a2c-55b35b45fb67 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:57.351865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1071/2140] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:57.356359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f17208-b6c7-4c61-90d0-836ea925c3f1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:57.367810 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f17208-b6c7-4c61-90d0-836ea925c3f1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:57.373298 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2552a-cd0e-4fdb-b612-4d81a6ca408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:57.373942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2552a-cd0e-4fdb-b612-4d81a6ca408d admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.374219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2552a-cd0e-4fdb-b612-4d81a6ca408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.374491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2552a-cd0e-4fdb-b612-4d81a6ca408d admin admin] PATH_INFO: `/v3/projects/100ba7a6180d4cbeb046c1d24e6384e0/users/a0d88c67860b49c7aed505c73f67ee97/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.389404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2552a-cd0e-4fdb-b612-4d81a6ca408d admin admin] RBAC: Authorizing `identity:create_grant(project_id=100ba7a6180d4cbeb046c1d24e6384e0, user_id=a0d88c67860b49c7aed505c73f67ee97, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:57.392090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2552a-cd0e-4fdb-b612-4d81a6ca408d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:57.408924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1070/2141] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:57 2022] PUT /identity/v3/projects/100ba7a6180d4cbeb046c1d24e6384e0/users/a0d88c67860b49c7aed505c73f67ee97/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:57.412920 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8576c-b5bc-4e49-9a2c-55b35b45fb67 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:57.423780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8576c-b5bc-4e49-9a2c-55b35b45fb67 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:57.486713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a00560-9a4b-4264-bd47-9179b4e1eb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:57.487394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a00560-9a4b-4264-bd47-9179b4e1eb7a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.487679 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a00560-9a4b-4264-bd47-9179b4e1eb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.487956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a00560-9a4b-4264-bd47-9179b4e1eb7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.488594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a00560-9a4b-4264-bd47-9179b4e1eb7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:57.490168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a00560-9a4b-4264-bd47-9179b4e1eb7a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:57.502015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1072/2142] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:35:57.504643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2552a-cd0e-4fdb-b612-4d81a6ca408d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:57.515087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2552a-cd0e-4fdb-b612-4d81a6ca408d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:57.519771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762997eb-5e24-426f-8adc-d56a9456ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:57.520499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762997eb-5e24-426f-8adc-d56a9456ba52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.520772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762997eb-5e24-426f-8adc-d56a9456ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.521037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762997eb-5e24-426f-8adc-d56a9456ba52 admin admin] PATH_INFO: `/v3/projects/100ba7a6180d4cbeb046c1d24e6384e0/users/a0d88c67860b49c7aed505c73f67ee97/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.523518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762997eb-5e24-426f-8adc-d56a9456ba52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100ba7a6180d4cbeb046c1d24e6384e0, user_id=a0d88c67860b49c7aed505c73f67ee97, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:57.526121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762997eb-5e24-426f-8adc-d56a9456ba52 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:57.536326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1071/2143] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:57 2022] PUT /identity/v3/projects/100ba7a6180d4cbeb046c1d24e6384e0/users/a0d88c67860b49c7aed505c73f67ee97/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:57.548563 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b039-9d90-4a66-893a-6e9d8966e212 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.548852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b039-9d90-4a66-893a-6e9d8966e212 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.549152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b039-9d90-4a66-893a-6e9d8966e212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.578452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5be0b039-9d90-4a66-893a-6e9d8966e212 None None] MFA Rules not processed for user `a0d88c67860b49c7aed505c73f67ee97`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:57.579709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5be0b039-9d90-4a66-893a-6e9d8966e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:57.649279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1073/2144] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:57.660799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762997eb-5e24-426f-8adc-d56a9456ba52 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:57.662535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-762997eb-5e24-426f-8adc-d56a9456ba52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:57.722036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762997eb-5e24-426f-8adc-d56a9456ba52 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:57.726391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b1e91-803e-4107-aed3-e674e77644e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:57.727046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b1e91-803e-4107-aed3-e674e77644e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.727324 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b1e91-803e-4107-aed3-e674e77644e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.727595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b1e91-803e-4107-aed3-e674e77644e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.737181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b1e91-803e-4107-aed3-e674e77644e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:57.738620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b1e91-803e-4107-aed3-e674e77644e1 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:57.750425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1072/2145] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:57.824085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b039-9d90-4a66-893a-6e9d8966e212 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:57.825491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5be0b039-9d90-4a66-893a-6e9d8966e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:57.871915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:57.879617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b1e91-803e-4107-aed3-e674e77644e1 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:57.881056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9b1b1e91-803e-4107-aed3-e674e77644e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:57.894496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:57.901371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b1e91-803e-4107-aed3-e674e77644e1 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:57.906445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acbe76-b6ad-4fa1-b43a-c8c29472266c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:57.907656 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acbe76-b6ad-4fa1-b43a-c8c29472266c service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.908249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acbe76-b6ad-4fa1-b43a-c8c29472266c service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.908725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acbe76-b6ad-4fa1-b43a-c8c29472266c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.935948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b039-9d90-4a66-893a-6e9d8966e212 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:57.941170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:57.941834 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:57.942146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:57.942421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] PATH_INFO: `/v3/users/638b087f281c45ce81ac1d9cdd95b96d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:57.943674 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=638b087f281c45ce81ac1d9cdd95b96d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:57.946151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:57.980751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acbe76-b6ad-4fa1-b43a-c8c29472266c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:57.982828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acbe76-b6ad-4fa1-b43a-c8c29472266c service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:57.994385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1073/2146] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:35:57.995201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acbe76-b6ad-4fa1-b43a-c8c29472266c service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:58.008282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acbe76-b6ad-4fa1-b43a-c8c29472266c service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:58.013560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb0536-4d88-4dde-8d60-bbb9402eca52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:58.014770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb0536-4d88-4dde-8d60-bbb9402eca52 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:58.015245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb0536-4d88-4dde-8d60-bbb9402eca52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:58.015759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb0536-4d88-4dde-8d60-bbb9402eca52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:58.016522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638b087f281c45ce81ac1d9cdd95b96d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:58.017346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638b087f281c45ce81ac1d9cdd95b96d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:58.017875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-72bb0536-4d88-4dde-8d60-bbb9402eca52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:58.028770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638b087f281c45ce81ac1d9cdd95b96d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:58.029692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638b087f281c45ce81ac1d9cdd95b96d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:58.051628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-398bda0f-3faa-4fe8-b61c-5a89c6786ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638b087f281c45ce81ac1d9cdd95b96d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:58.073284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1074/2147] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:35:57 2022] DELETE /identity/v3/users/638b087f281c45ce81ac1d9cdd95b96d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:58.077811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe29dec-f827-4cf2-a1e0-fd3a90462dcf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:58.078193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe29dec-f827-4cf2-a1e0-fd3a90462dcf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:58.078467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe29dec-f827-4cf2-a1e0-fd3a90462dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:58.098533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cbe29dec-f827-4cf2-a1e0-fd3a90462dcf None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:58.099764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cbe29dec-f827-4cf2-a1e0-fd3a90462dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:58.109711 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb0536-4d88-4dde-8d60-bbb9402eca52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:58.111262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb0536-4d88-4dde-8d60-bbb9402eca52 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:58.123215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1074/2148] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:58.173172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1075/2149] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:58.184222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb0536-4d88-4dde-8d60-bbb9402eca52 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:58.185744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-72bb0536-4d88-4dde-8d60-bbb9402eca52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:58.261161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb0536-4d88-4dde-8d60-bbb9402eca52 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:58.312049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ecdc-9bba-4338-aa34-826d6ad88796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:58.312774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ecdc-9bba-4338-aa34-826d6ad88796 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:58.313054 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ecdc-9bba-4338-aa34-826d6ad88796 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:58.313326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ecdc-9bba-4338-aa34-826d6ad88796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:58.322768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122ecdc-9bba-4338-aa34-826d6ad88796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:58.324211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122ecdc-9bba-4338-aa34-826d6ad88796 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:58.329130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:58.335361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1075/2150] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:58.636256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe29dec-f827-4cf2-a1e0-fd3a90462dcf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:58.639374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cbe29dec-f827-4cf2-a1e0-fd3a90462dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:58.656199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe29dec-f827-4cf2-a1e0-fd3a90462dcf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:58.682417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:58.682417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:58.682658 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:58.683054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] PATH_INFO: `/v3/projects/87322cc3456a41c78eafcf7963ecbbd3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:58.697018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87322cc3456a41c78eafcf7963ecbbd3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:58.699286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:58.762855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:58.781085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ecdc-9bba-4338-aa34-826d6ad88796 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:58.781860 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87322cc3456a41c78eafcf7963ecbbd3', 'request_id': 'req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:58.782911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3122ecdc-9bba-4338-aa34-826d6ad88796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:58.794630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87322cc3456a41c78eafcf7963ecbbd3', 'request_id': 'req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:58.802688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87322cc3456a41c78eafcf7963ecbbd3', 'request_id': 'req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:58.821219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] The token cache is being invalidate because project 87322cc3456a41c78eafcf7963ecbbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:35:58.821514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:58.822458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a1ab6744-2ce5-40a9-b3a6-14c87b37ded9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:35:58.825098 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1076/2151] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:35:58 2022] DELETE /identity/v3/projects/87322cc3456a41c78eafcf7963ecbbd3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:58.832917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1808310-2e0c-4e27-87bc-d5c4f2509b63 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:58.833210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1808310-2e0c-4e27-87bc-d5c4f2509b63 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:58.833539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1808310-2e0c-4e27-87bc-d5c4f2509b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:58.862028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ecdc-9bba-4338-aa34-826d6ad88796 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:58.868982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f1808310-2e0c-4e27-87bc-d5c4f2509b63 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:58.870187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f1808310-2e0c-4e27-87bc-d5c4f2509b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:58.950233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc4693-f412-424e-8d3b-c7cdd4e58276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:58.950891 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc4693-f412-424e-8d3b-c7cdd4e58276 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:58.951165 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc4693-f412-424e-8d3b-c7cdd4e58276 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:58.951444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc4693-f412-424e-8d3b-c7cdd4e58276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:58.958666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1077/2152] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:58.959184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dabc4693-f412-424e-8d3b-c7cdd4e58276 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:58.960858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a62d-c8e8-4c5b-8845-ffdf39064f8c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:58.961148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a62d-c8e8-4c5b-8845-ffdf39064f8c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:58.961473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a62d-c8e8-4c5b-8845-ffdf39064f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:58.993192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2628a62d-c8e8-4c5b-8845-ffdf39064f8c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:58.994296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2628a62d-c8e8-4c5b-8845-ffdf39064f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:59.008398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1078/2153] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:35:59.012804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a62d-c8e8-4c5b-8845-ffdf39064f8c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:59.032143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc4693-f412-424e-8d3b-c7cdd4e58276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:59.033081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a62d-c8e8-4c5b-8845-ffdf39064f8c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:59.035278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc4693-f412-424e-8d3b-c7cdd4e58276 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:59.039039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a0453-1ec9-4916-a8a2-8723d3c4cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:59.039858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a0453-1ec9-4916-a8a2-8723d3c4cdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:59.040144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a0453-1ec9-4916-a8a2-8723d3c4cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:59.040863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a0453-1ec9-4916-a8a2-8723d3c4cdb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:59.041894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a0453-1ec9-4916-a8a2-8723d3c4cdb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:59.042343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a0453-1ec9-4916-a8a2-8723d3c4cdb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:59.044169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a0453-1ec9-4916-a8a2-8723d3c4cdb1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:59.051890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1076/2154] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:35:59.061590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1079/2155] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:59.066043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc4693-f412-424e-8d3b-c7cdd4e58276 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:59.080343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc4693-f412-424e-8d3b-c7cdd4e58276 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:59.088868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d6853-97df-49d3-8a1e-8494914cdd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:59.089492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6853-97df-49d3-8a1e-8494914cdd32 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:59.089768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6853-97df-49d3-8a1e-8494914cdd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:59.090039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6853-97df-49d3-8a1e-8494914cdd32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:59.090694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d6853-97df-49d3-8a1e-8494914cdd32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:59.092904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d6853-97df-49d3-8a1e-8494914cdd32 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:59.153105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1077/2156] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:35:59 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:59.157122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a0453-1ec9-4916-a8a2-8723d3c4cdb1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:59.178343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a0453-1ec9-4916-a8a2-8723d3c4cdb1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:59.326347 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89c97d-41d4-4106-9dce-2903cfe85309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:59.327010 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c97d-41d4-4106-9dce-2903cfe85309 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:59.327295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c97d-41d4-4106-9dce-2903cfe85309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:59.327570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c97d-41d4-4106-9dce-2903cfe85309 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:59.331327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89c97d-41d4-4106-9dce-2903cfe85309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:59.333384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89c97d-41d4-4106-9dce-2903cfe85309 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:59.380037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1080/2157] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:35:59 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:59.384474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d6853-97df-49d3-8a1e-8494914cdd32 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:59.397789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d6853-97df-49d3-8a1e-8494914cdd32 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:59.403475 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662ff74-8bad-4af6-aca5-8bb38a535471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:59.404338 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662ff74-8bad-4af6-aca5-8bb38a535471 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:59.404803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662ff74-8bad-4af6-aca5-8bb38a535471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:59.405279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662ff74-8bad-4af6-aca5-8bb38a535471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:59.406105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662ff74-8bad-4af6-aca5-8bb38a535471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:59.408453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662ff74-8bad-4af6-aca5-8bb38a535471 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:59.422717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1078/2158] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:59.425714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89c97d-41d4-4106-9dce-2903cfe85309 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:59.437961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89c97d-41d4-4106-9dce-2903cfe85309 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:59.445669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf74405-8a2e-4bd1-b499-c15e833f7b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:59.446337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf74405-8a2e-4bd1-b499-c15e833f7b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:59.446654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf74405-8a2e-4bd1-b499-c15e833f7b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:59.447006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf74405-8a2e-4bd1-b499-c15e833f7b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:59.447812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf74405-8a2e-4bd1-b499-c15e833f7b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:59.449460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf74405-8a2e-4bd1-b499-c15e833f7b28 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:59.471062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1081/2159] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:35:59.475364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662ff74-8bad-4af6-aca5-8bb38a535471 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:59.487254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662ff74-8bad-4af6-aca5-8bb38a535471 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:59.493069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa31d71-15c7-4206-8db6-082679451f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:59.493791 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa31d71-15c7-4206-8db6-082679451f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:59.494072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa31d71-15c7-4206-8db6-082679451f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:59.494450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa31d71-15c7-4206-8db6-082679451f5e admin admin] PATH_INFO: `/v3/projects/ee6b5090dce0427787766ccfa55e060f/users/2163bb976c3b4988851baa521e038785/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:59.513016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa31d71-15c7-4206-8db6-082679451f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6b5090dce0427787766ccfa55e060f, user_id=2163bb976c3b4988851baa521e038785, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:59.515818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa31d71-15c7-4206-8db6-082679451f5e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:59.533361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1079/2160] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:35:59 2022] PUT /identity/v3/projects/ee6b5090dce0427787766ccfa55e060f/users/2163bb976c3b4988851baa521e038785/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:35:59.544898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463aa0-1b9c-41ab-95b2-11ea55031637 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:59.545391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463aa0-1b9c-41ab-95b2-11ea55031637 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:59.546864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463aa0-1b9c-41ab-95b2-11ea55031637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:59.580267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c1463aa0-1b9c-41ab-95b2-11ea55031637 None None] MFA Rules not processed for user `2163bb976c3b4988851baa521e038785`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:59.581317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c1463aa0-1b9c-41ab-95b2-11ea55031637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:59.596292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:59.674702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1082/2161] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:35:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:35:59.686073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa31d71-15c7-4206-8db6-082679451f5e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:59.688606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5fa31d71-15c7-4206-8db6-082679451f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:59.704518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:59.784174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa31d71-15c7-4206-8db6-082679451f5e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:59.788109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837b9ec-7a8e-477a-a163-55e15201fb6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b2324f9166d4c2dac76f08b03991769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:59.789117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b9ec-7a8e-477a-a163-55e15201fb6a service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:59.789117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b9ec-7a8e-477a-a163-55e15201fb6a service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:59.789437 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b9ec-7a8e-477a-a163-55e15201fb6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:59.797954 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837b9ec-7a8e-477a-a163-55e15201fb6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:59.799449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837b9ec-7a8e-477a-a163-55e15201fb6a service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:59.810095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1080/2162] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:35:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:01.031834 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1463aa0-1b9c-41ab-95b2-11ea55031637 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:01.034043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c1463aa0-1b9c-41ab-95b2-11ea55031637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:01.113089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1463aa0-1b9c-41ab-95b2-11ea55031637 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:01.119234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:01.119608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:01.119959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:01.120412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] PATH_INFO: `/v3/users/c57954e8c1234f7ca93855fa3920ed9f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:01.121610 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c57954e8c1234f7ca93855fa3920ed9f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:01.123650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:01.173296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c57954e8c1234f7ca93855fa3920ed9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:01.173956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c57954e8c1234f7ca93855fa3920ed9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:01.181322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c57954e8c1234f7ca93855fa3920ed9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:01.181963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c57954e8c1234f7ca93855fa3920ed9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:01.195316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c57954e8c1234f7ca93855fa3920ed9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:01.213903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1083/2163] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:01 2022] DELETE /identity/v3/users/c57954e8c1234f7ca93855fa3920ed9f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:01.219647 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7718-5f4a-4fe8-acea-6d55bc47d0f4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:01.220534 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7718-5f4a-4fe8-acea-6d55bc47d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:01.220534 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7718-5f4a-4fe8-acea-6d55bc47d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:01.246115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-242c7718-5f4a-4fe8-acea-6d55bc47d0f4 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:01.247445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-242c7718-5f4a-4fe8-acea-6d55bc47d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:01.320299 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1081/2164] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:01.330246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:01.331870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:01.370102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:01.397621 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272cae8-4933-45db-95b6-3ef4666a787f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:01.401583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f7a95-6684-4191-85f6-8abd97d02b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:01.402268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f7a95-6684-4191-85f6-8abd97d02b3a service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:01.402552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f7a95-6684-4191-85f6-8abd97d02b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:01.402861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f7a95-6684-4191-85f6-8abd97d02b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:01.421595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f7a95-6684-4191-85f6-8abd97d02b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:01.423146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f7a95-6684-4191-85f6-8abd97d02b3a service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:01.434057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1084/2165] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:01.735596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c7718-5f4a-4fe8-acea-6d55bc47d0f4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:01.742604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-242c7718-5f4a-4fe8-acea-6d55bc47d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:01.769753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c7718-5f4a-4fe8-acea-6d55bc47d0f4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:01.777010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:01.778444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:01.778754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:01.779023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] PATH_INFO: `/v3/projects/de0c2ef6993d4a50b2a1da9d4a7313f4` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:01.780792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0c2ef6993d4a50b2a1da9d4a7313f4)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:01.784316 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:01.841498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0c2ef6993d4a50b2a1da9d4a7313f4', 'request_id': 'req-f776d2a5-8b29-40f9-b08d-3e088fe27e98'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:01.847853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0c2ef6993d4a50b2a1da9d4a7313f4', 'request_id': 'req-f776d2a5-8b29-40f9-b08d-3e088fe27e98'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:01.857928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0c2ef6993d4a50b2a1da9d4a7313f4', 'request_id': 'req-f776d2a5-8b29-40f9-b08d-3e088fe27e98'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:01.880234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] The token cache is being invalidate because project de0c2ef6993d4a50b2a1da9d4a7313f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:01.880700 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:01.881453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:01.883984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1082/2166] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:01 2022] DELETE /identity/v3/projects/de0c2ef6993d4a50b2a1da9d4a7313f4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:01.887788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f7a95-6684-4191-85f6-8abd97d02b3a service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:01.905131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f7a95-6684-4191-85f6-8abd97d02b3a service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:01.995801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:01.996855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:01.997139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:01.997408 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] PATH_INFO: `/v3/users/3b198145780f440a8346169b9e10bbfb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:01.998563 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b198145780f440a8346169b9e10bbfb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:02.000705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:02.063442 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b198145780f440a8346169b9e10bbfb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:02.064156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b198145780f440a8346169b9e10bbfb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:02.072532 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b198145780f440a8346169b9e10bbfb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:02.073198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b198145780f440a8346169b9e10bbfb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:02.086358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5fdc6b76-430d-40f0-be30-935ec1278948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b198145780f440a8346169b9e10bbfb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:02.106004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1085/2167] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:01 2022] DELETE /identity/v3/users/3b198145780f440a8346169b9e10bbfb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:36:02.405007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:02.406468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:02.420354 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776d2a5-8b29-40f9-b08d-3e088fe27e98 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:02.463497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:02.490399 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:02.491775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:02.492010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:02.492306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] PATH_INFO: `/v3/projects/bf12f0e4b67a4de88e0f796928ed7df1` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:02.493482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf12f0e4b67a4de88e0f796928ed7df1)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:02.495446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:02.550263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf12f0e4b67a4de88e0f796928ed7df1', 'request_id': 'req-fb899210-a38e-4af7-983c-8365eea96cf3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:02.557484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf12f0e4b67a4de88e0f796928ed7df1', 'request_id': 'req-fb899210-a38e-4af7-983c-8365eea96cf3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:02.563117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf12f0e4b67a4de88e0f796928ed7df1', 'request_id': 'req-fb899210-a38e-4af7-983c-8365eea96cf3'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:02.577347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] The token cache is being invalidate because project bf12f0e4b67a4de88e0f796928ed7df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:02.577636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:02.578423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fb899210-a38e-4af7-983c-8365eea96cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:02.580097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1083/2168] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:02 2022] DELETE /identity/v3/projects/bf12f0e4b67a4de88e0f796928ed7df1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:02.587647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789e32-a414-4b46-b565-f35a44afde97 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:02.587647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789e32-a414-4b46-b565-f35a44afde97 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:02.587647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789e32-a414-4b46-b565-f35a44afde97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:02.607451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-52789e32-a414-4b46-b565-f35a44afde97 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:02.608740 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-52789e32-a414-4b46-b565-f35a44afde97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:02.658693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:02.682765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1086/2169] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:02.685717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98052652-8b37-4155-b7b2-88463335538c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:02.686002 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98052652-8b37-4155-b7b2-88463335538c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:02.686274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98052652-8b37-4155-b7b2-88463335538c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:02.706501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-98052652-8b37-4155-b7b2-88463335538c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:02.707735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-98052652-8b37-4155-b7b2-88463335538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:02.719102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1084/2170] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:02.723386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789e32-a414-4b46-b565-f35a44afde97 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:02.733709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789e32-a414-4b46-b565-f35a44afde97 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:02.738387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a911f4f-c73e-4702-ae60-8ff0eea0e013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:02.739012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a911f4f-c73e-4702-ae60-8ff0eea0e013 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:02.739294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a911f4f-c73e-4702-ae60-8ff0eea0e013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:02.739566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a911f4f-c73e-4702-ae60-8ff0eea0e013 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:02.740212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a911f4f-c73e-4702-ae60-8ff0eea0e013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:02.740511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a911f4f-c73e-4702-ae60-8ff0eea0e013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:02.742165 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a911f4f-c73e-4702-ae60-8ff0eea0e013 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:02.753994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1087/2171] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:02.759269 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98052652-8b37-4155-b7b2-88463335538c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:02.768886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98052652-8b37-4155-b7b2-88463335538c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:02.774813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95319d-85bc-4f23-9a47-68799e6f993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:02.775447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95319d-85bc-4f23-9a47-68799e6f993b admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:02.775724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95319d-85bc-4f23-9a47-68799e6f993b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:02.775993 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95319d-85bc-4f23-9a47-68799e6f993b admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:02.776635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95319d-85bc-4f23-9a47-68799e6f993b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:02.778518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95319d-85bc-4f23-9a47-68799e6f993b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:02.807699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1085/2172] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:36:02 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:02.811732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a911f4f-c73e-4702-ae60-8ff0eea0e013 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:02.822155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a911f4f-c73e-4702-ae60-8ff0eea0e013 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:02.889839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2d444-b868-4d21-b79e-8d8f6d383691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:02.890577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d444-b868-4d21-b79e-8d8f6d383691 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:02.890903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d444-b868-4d21-b79e-8d8f6d383691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:02.891174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d444-b868-4d21-b79e-8d8f6d383691 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:02.891806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2d444-b868-4d21-b79e-8d8f6d383691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:02.894323 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2d444-b868-4d21-b79e-8d8f6d383691 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:02.921131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1088/2173] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:36:02 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:02.926391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95319d-85bc-4f23-9a47-68799e6f993b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:02.937757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95319d-85bc-4f23-9a47-68799e6f993b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:02.942818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfe0f-a6ac-4492-bc44-0a18ce279a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:02.943427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfe0f-a6ac-4492-bc44-0a18ce279a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:02.943843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfe0f-a6ac-4492-bc44-0a18ce279a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:02.944713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfe0f-a6ac-4492-bc44-0a18ce279a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:02.945397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bfe0f-a6ac-4492-bc44-0a18ce279a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:02.947064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bfe0f-a6ac-4492-bc44-0a18ce279a55 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:02.958809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1086/2174] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:02.962321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2d444-b868-4d21-b79e-8d8f6d383691 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:02.974727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2d444-b868-4d21-b79e-8d8f6d383691 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:02.991028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7b31d-8a08-47bd-8552-90ab0a33d979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:02.991028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7b31d-8a08-47bd-8552-90ab0a33d979 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:02.991028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7b31d-8a08-47bd-8552-90ab0a33d979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:02.991028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7b31d-8a08-47bd-8552-90ab0a33d979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:02.991579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7b31d-8a08-47bd-8552-90ab0a33d979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:02.991579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7b31d-8a08-47bd-8552-90ab0a33d979 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:02.998329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1089/2175] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:03.002734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfe0f-a6ac-4492-bc44-0a18ce279a55 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:03.014372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfe0f-a6ac-4492-bc44-0a18ce279a55 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:03.019247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243331-edaf-4ef8-b401-9d8fc1426c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:03.019895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243331-edaf-4ef8-b401-9d8fc1426c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:03.020169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243331-edaf-4ef8-b401-9d8fc1426c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:03.020439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243331-edaf-4ef8-b401-9d8fc1426c70 admin admin] PATH_INFO: `/v3/projects/e7a024b5e0df48f389ae52c68af0e6d1/users/3e760eb6a29c400bbc0a207a06e39229/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:03.040232 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c243331-edaf-4ef8-b401-9d8fc1426c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a024b5e0df48f389ae52c68af0e6d1, user_id=3e760eb6a29c400bbc0a207a06e39229, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:03.044368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c243331-edaf-4ef8-b401-9d8fc1426c70 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:03.066155 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1087/2176] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:03 2022] PUT /identity/v3/projects/e7a024b5e0df48f389ae52c68af0e6d1/users/3e760eb6a29c400bbc0a207a06e39229/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:03.079479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fb1d5-eed3-4043-9a70-19cd41407560 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:03.080151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fb1d5-eed3-4043-9a70-19cd41407560 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:03.080151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fb1d5-eed3-4043-9a70-19cd41407560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:03.117837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-409fb1d5-eed3-4043-9a70-19cd41407560 None None] MFA Rules not processed for user `3e760eb6a29c400bbc0a207a06e39229`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:03.120002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-409fb1d5-eed3-4043-9a70-19cd41407560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:03.195098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243331-edaf-4ef8-b401-9d8fc1426c70 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:03.197063 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7c243331-edaf-4ef8-b401-9d8fc1426c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:03.211452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1090/2177] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:03.227104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fb1d5-eed3-4043-9a70-19cd41407560 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:03.229022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-409fb1d5-eed3-4043-9a70-19cd41407560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:03.309658 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:03.310769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243331-edaf-4ef8-b401-9d8fc1426c70 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:03.316028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:03.316410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fb1d5-eed3-4043-9a70-19cd41407560 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:03.316664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:03.316953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:03.317293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] PATH_INFO: `/v3/users/82f95a795dc64d2eab783001bb807056` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:03.318450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f95a795dc64d2eab783001bb807056)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:03.320780 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:03.320890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6832275-fa43-4a9b-a0c2-ef5fcd90da44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:03.321653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832275-fa43-4a9b-a0c2-ef5fcd90da44 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:03.321872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832275-fa43-4a9b-a0c2-ef5fcd90da44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:03.322225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832275-fa43-4a9b-a0c2-ef5fcd90da44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:03.324572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:03.336263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6832275-fa43-4a9b-a0c2-ef5fcd90da44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:03.337765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6832275-fa43-4a9b-a0c2-ef5fcd90da44 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:03.349713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1091/2178] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:03.380842 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6832275-fa43-4a9b-a0c2-ef5fcd90da44 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:03.392409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f95a795dc64d2eab783001bb807056'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:03.393415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f95a795dc64d2eab783001bb807056'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:03.393948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6832275-fa43-4a9b-a0c2-ef5fcd90da44 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:03.400619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:03.401274 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:03.401549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:03.401986 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] PATH_INFO: `/v3/users/3e760eb6a29c400bbc0a207a06e39229` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:03.403487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e760eb6a29c400bbc0a207a06e39229)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:03.405437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:03.407943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f95a795dc64d2eab783001bb807056'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:03.417128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f95a795dc64d2eab783001bb807056'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:03.417946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9ab32c6b-8bdc-457f-a844-2528d69b7d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f95a795dc64d2eab783001bb807056'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:03.443693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1088/2179] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:03 2022] DELETE /identity/v3/users/82f95a795dc64d2eab783001bb807056 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:36:03.448545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4290d11-ceaa-4e62-9d45-049890ba57e0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:03.448828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4290d11-ceaa-4e62-9d45-049890ba57e0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:03.449136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4290d11-ceaa-4e62-9d45-049890ba57e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:03.467105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e760eb6a29c400bbc0a207a06e39229'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:03.467846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e760eb6a29c400bbc0a207a06e39229'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:03.470797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b4290d11-ceaa-4e62-9d45-049890ba57e0 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:03.472335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b4290d11-ceaa-4e62-9d45-049890ba57e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:03.480156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e760eb6a29c400bbc0a207a06e39229'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:03.480156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e760eb6a29c400bbc0a207a06e39229'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:03.495077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-116f9059-e51b-4e6c-b8be-49a45fd86ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e760eb6a29c400bbc0a207a06e39229'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:03.510550 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1092/2180] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:03 2022] DELETE /identity/v3/users/3e760eb6a29c400bbc0a207a06e39229 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:36:03.515242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791409b6-7880-4c4f-89f9-cc4b5cbd42b1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:03.515541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791409b6-7880-4c4f-89f9-cc4b5cbd42b1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:03.515819 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791409b6-7880-4c4f-89f9-cc4b5cbd42b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:03.540427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-791409b6-7880-4c4f-89f9-cc4b5cbd42b1 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:03.541917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-791409b6-7880-4c4f-89f9-cc4b5cbd42b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:03.550608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1089/2181] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:03.561169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4290d11-ceaa-4e62-9d45-049890ba57e0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:03.563141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b4290d11-ceaa-4e62-9d45-049890ba57e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:03.620651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1093/2182] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:36:03.630427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791409b6-7880-4c4f-89f9-cc4b5cbd42b1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:03.632421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-791409b6-7880-4c4f-89f9-cc4b5cbd42b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:03.636001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4290d11-ceaa-4e62-9d45-049890ba57e0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:03.676290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:03.695969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c883e3e-45de-46f9-a956-43275087745b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:03.696720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883e3e-45de-46f9-a956-43275087745b service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:03.697000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883e3e-45de-46f9-a956-43275087745b service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:03.697106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791409b6-7880-4c4f-89f9-cc4b5cbd42b1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:03.697297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883e3e-45de-46f9-a956-43275087745b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:03.701103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c30b-a94c-4127-a15e-9342ba66ab09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:03.701703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c30b-a94c-4127-a15e-9342ba66ab09 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:03.701983 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c30b-a94c-4127-a15e-9342ba66ab09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:03.702256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c30b-a94c-4127-a15e-9342ba66ab09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:03.706734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c883e3e-45de-46f9-a956-43275087745b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:03.708175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c883e3e-45de-46f9-a956-43275087745b service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:03.713870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c30b-a94c-4127-a15e-9342ba66ab09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:03.715354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c30b-a94c-4127-a15e-9342ba66ab09 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:03.719251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1090/2183] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:03.726161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1094/2184] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:36:04.050402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c30b-a94c-4127-a15e-9342ba66ab09 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:04.061518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3f8c30b-a94c-4127-a15e-9342ba66ab09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:04.076775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c30b-a94c-4127-a15e-9342ba66ab09 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:04.083109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:04.085184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.085814 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.086317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] PATH_INFO: `/v3/projects/e7a024b5e0df48f389ae52c68af0e6d1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.087718 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7a024b5e0df48f389ae52c68af0e6d1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:04.090068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:04.092442 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:04.157670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a024b5e0df48f389ae52c68af0e6d1', 'request_id': 'req-27846e99-8dc4-426d-87e1-7447c8d080bd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.164577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a024b5e0df48f389ae52c68af0e6d1', 'request_id': 'req-27846e99-8dc4-426d-87e1-7447c8d080bd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.171730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a024b5e0df48f389ae52c68af0e6d1', 'request_id': 'req-27846e99-8dc4-426d-87e1-7447c8d080bd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.191415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c883e3e-45de-46f9-a956-43275087745b service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:04.205069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] The token cache is being invalidate because project e7a024b5e0df48f389ae52c68af0e6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:04.205466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.205581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1c883e3e-45de-46f9-a956-43275087745b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:04.206182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-27846e99-8dc4-426d-87e1-7447c8d080bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.208072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1095/2185] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:04 2022] DELETE /identity/v3/projects/e7a024b5e0df48f389ae52c68af0e6d1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:04.213538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e891-9058-4f4b-a099-7226d23cdc41 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.213831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e891-9058-4f4b-a099-7226d23cdc41 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.214118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e891-9058-4f4b-a099-7226d23cdc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.229219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c883e3e-45de-46f9-a956-43275087745b service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:04.240981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0fd6e891-9058-4f4b-a099-7226d23cdc41 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:04.242794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0fd6e891-9058-4f4b-a099-7226d23cdc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:04.300589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:04.301273 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.301557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.301831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] PATH_INFO: `/v3/projects/d8fbf6401fad4b75a7c3b3f1a1286785` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.303788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fbf6401fad4b75a7c3b3f1a1286785)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:04.305712 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:04.316070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1096/2186] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:36:04.324524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c211-a41e-4f80-ab73-baf0da77a61f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.324902 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c211-a41e-4f80-ab73-baf0da77a61f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.325073 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c211-a41e-4f80-ab73-baf0da77a61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.362001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6688c211-a41e-4f80-ab73-baf0da77a61f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:04.364373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6688c211-a41e-4f80-ab73-baf0da77a61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:04.378517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1097/2187] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:04.379750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688c211-a41e-4f80-ab73-baf0da77a61f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:04.392303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688c211-a41e-4f80-ab73-baf0da77a61f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:04.400715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fbf6401fad4b75a7c3b3f1a1286785', 'request_id': 'req-c1c8c64b-69c9-4a6b-8dce-7def324f95be'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.410218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fbf6401fad4b75a7c3b3f1a1286785', 'request_id': 'req-c1c8c64b-69c9-4a6b-8dce-7def324f95be'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.418019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fbf6401fad4b75a7c3b3f1a1286785', 'request_id': 'req-c1c8c64b-69c9-4a6b-8dce-7def324f95be'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.446053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] The token cache is being invalidate because project d8fbf6401fad4b75a7c3b3f1a1286785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:04.446823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.448403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.451893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1091/2188] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:04 2022] DELETE /identity/v3/projects/d8fbf6401fad4b75a7c3b3f1a1286785 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:04.455798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:04.457542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:04.470454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bae68-61b0-4723-ba8c-4d153e732f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:04.471467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bae68-61b0-4723-ba8c-4d153e732f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.472030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bae68-61b0-4723-ba8c-4d153e732f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.472453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bae68-61b0-4723-ba8c-4d153e732f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.473341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bae68-61b0-4723-ba8c-4d153e732f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:04.474524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bae68-61b0-4723-ba8c-4d153e732f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:04.478566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bae68-61b0-4723-ba8c-4d153e732f1e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:04.497207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1098/2189] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:04.501416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bae68-61b0-4723-ba8c-4d153e732f1e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:04.504133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c0bae68-61b0-4723-ba8c-4d153e732f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:04.520628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bae68-61b0-4723-ba8c-4d153e732f1e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:04.533677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1532622-8083-40a9-bb6f-3e4981d73e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:04.534440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1532622-8083-40a9-bb6f-3e4981d73e2e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.535132 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1532622-8083-40a9-bb6f-3e4981d73e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.535383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1532622-8083-40a9-bb6f-3e4981d73e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.536100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1532622-8083-40a9-bb6f-3e4981d73e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:04.538125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1532622-8083-40a9-bb6f-3e4981d73e2e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:04.547167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8c64b-69c9-4a6b-8dce-7def324f95be admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:04.552986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:04.553626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.553892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.554172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] PATH_INFO: `/v3/users/5fe03d6ada1a48a7b63409a501dbc925` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.555359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe03d6ada1a48a7b63409a501dbc925)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:04.555718 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:04.557663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:04.569859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1099/2190] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:36:04 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:04.572442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:04.574370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1532622-8083-40a9-bb6f-3e4981d73e2e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:04.614726 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe03d6ada1a48a7b63409a501dbc925'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.615505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe03d6ada1a48a7b63409a501dbc925'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.628524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe03d6ada1a48a7b63409a501dbc925'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.637836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe03d6ada1a48a7b63409a501dbc925'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.638797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe03d6ada1a48a7b63409a501dbc925'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:04.646417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1532622-8083-40a9-bb6f-3e4981d73e2e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:04.652017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4caede-02e7-4013-9c47-8741fa896bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:04.652726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4caede-02e7-4013-9c47-8741fa896bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.653094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4caede-02e7-4013-9c47-8741fa896bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.653469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4caede-02e7-4013-9c47-8741fa896bfa admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.658731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4caede-02e7-4013-9c47-8741fa896bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:04.659374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1092/2191] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:04 2022] DELETE /identity/v3/users/5fe03d6ada1a48a7b63409a501dbc925 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:36:04.659460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4caede-02e7-4013-9c47-8741fa896bfa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:04.684831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1100/2192] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:36:04 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:36:04.686218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:04.687905 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:04.767614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f3a11-5b21-4987-aa53-eebd971e6017 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:04.773834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7e86-d0b3-45b0-b844-bd66b1662d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:04.774609 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7e86-d0b3-45b0-b844-bd66b1662d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.775033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7e86-d0b3-45b0-b844-bd66b1662d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.775358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7e86-d0b3-45b0-b844-bd66b1662d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.776014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa7e86-d0b3-45b0-b844-bd66b1662d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:04.777897 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa7e86-d0b3-45b0-b844-bd66b1662d17 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:04.791842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1093/2193] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:04.793028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4caede-02e7-4013-9c47-8741fa896bfa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:04.803851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4caede-02e7-4013-9c47-8741fa896bfa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:04.808341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13459f-ef02-434d-873c-a31158821666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:04.808938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13459f-ef02-434d-873c-a31158821666 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.809212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13459f-ef02-434d-873c-a31158821666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.809481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13459f-ef02-434d-873c-a31158821666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.810119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13459f-ef02-434d-873c-a31158821666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:04.811743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13459f-ef02-434d-873c-a31158821666 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:04.823363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1101/2194] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:04.831710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7e86-d0b3-45b0-b844-bd66b1662d17 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:04.844018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7e86-d0b3-45b0-b844-bd66b1662d17 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:04.849542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953aecd-e2ae-423f-9a0a-27f9bc1786ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:04.850262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953aecd-e2ae-423f-9a0a-27f9bc1786ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.850561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953aecd-e2ae-423f-9a0a-27f9bc1786ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.850885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953aecd-e2ae-423f-9a0a-27f9bc1786ab admin admin] PATH_INFO: `/v3/projects/bcb8fe7b87ef4e2ea70f12da1435a369/users/85640328abfb4f6094bff577d4979a62/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.868969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953aecd-e2ae-423f-9a0a-27f9bc1786ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb8fe7b87ef4e2ea70f12da1435a369, user_id=85640328abfb4f6094bff577d4979a62, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:04.872606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953aecd-e2ae-423f-9a0a-27f9bc1786ab admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:04.887739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1094/2195] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:04 2022] PUT /identity/v3/projects/bcb8fe7b87ef4e2ea70f12da1435a369/users/85640328abfb4f6094bff577d4979a62/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:04.898897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79da9ca-3646-45ec-8b74-33bda0df12c3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:04.899182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79da9ca-3646-45ec-8b74-33bda0df12c3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:04.899457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79da9ca-3646-45ec-8b74-33bda0df12c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:04.928656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f79da9ca-3646-45ec-8b74-33bda0df12c3 None None] MFA Rules not processed for user `85640328abfb4f6094bff577d4979a62`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:04.929878 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f79da9ca-3646-45ec-8b74-33bda0df12c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:04.964164 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953aecd-e2ae-423f-9a0a-27f9bc1786ab admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:04.968464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d953aecd-e2ae-423f-9a0a-27f9bc1786ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:05.013111 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1102/2196] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:05.024184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79da9ca-3646-45ec-8b74-33bda0df12c3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:05.025690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f79da9ca-3646-45ec-8b74-33bda0df12c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:05.056169 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953aecd-e2ae-423f-9a0a-27f9bc1786ab admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:05.060950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:05.061669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:05.061988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:05.062301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] PATH_INFO: `/v3/projects/c3956ecb45484061aac8703d3fe46882` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:05.063570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3956ecb45484061aac8703d3fe46882)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:05.065697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:05.068179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:05.096359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79da9ca-3646-45ec-8b74-33bda0df12c3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:05.101592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709492-d6f5-4eeb-8bf2-a444c0189fd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:05.102268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709492-d6f5-4eeb-8bf2-a444c0189fd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:05.102545 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709492-d6f5-4eeb-8bf2-a444c0189fd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:05.102918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709492-d6f5-4eeb-8bf2-a444c0189fd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:05.112299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709492-d6f5-4eeb-8bf2-a444c0189fd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:05.113777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709492-d6f5-4eeb-8bf2-a444c0189fd7 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:05.124333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1103/2197] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:36:05.137485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3956ecb45484061aac8703d3fe46882', 'request_id': 'req-8e2d3401-0163-4ea7-ab06-0af0f642318f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.143783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3956ecb45484061aac8703d3fe46882', 'request_id': 'req-8e2d3401-0163-4ea7-ab06-0af0f642318f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.151038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3956ecb45484061aac8703d3fe46882', 'request_id': 'req-8e2d3401-0163-4ea7-ab06-0af0f642318f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.167327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] The token cache is being invalidate because project c3956ecb45484061aac8703d3fe46882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:05.167695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.168857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.170664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1095/2198] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:04 2022] DELETE /identity/v3/projects/c3956ecb45484061aac8703d3fe46882 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:36:05.175425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709492-d6f5-4eeb-8bf2-a444c0189fd7 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:05.190019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709492-d6f5-4eeb-8bf2-a444c0189fd7 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:05.195551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:05.271898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:05.272852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:05.273322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:05.274068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] PATH_INFO: `/v3/users/2cb5158ca2b14dc28365ecc289f5687a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:05.275560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb5158ca2b14dc28365ecc289f5687a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:05.278046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:05.356278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb5158ca2b14dc28365ecc289f5687a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.357071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb5158ca2b14dc28365ecc289f5687a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.365483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb5158ca2b14dc28365ecc289f5687a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.367295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb5158ca2b14dc28365ecc289f5687a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.382017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb5158ca2b14dc28365ecc289f5687a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.396780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1104/2199] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:05 2022] DELETE /identity/v3/users/2cb5158ca2b14dc28365ecc289f5687a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:05.705711 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:05.707393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:05.721520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d3401-0163-4ea7-ab06-0af0f642318f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:05.758871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:05.760282 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:05.809384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:05.810091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:05.810486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:05.810868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] PATH_INFO: `/v3/users/a9d7a390e4b84b51b6d78b844cf41ce5` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:05.812193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d7a390e4b84b51b6d78b844cf41ce5)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:05.820809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:05.838932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74327769-2f65-43e4-8897-27cf751864a0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:05.843753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:05.844403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:05.844688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:05.844994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] PATH_INFO: `/v3/projects/2d95ab48f7214c6788c6dc2b18856f37` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:05.846175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d95ab48f7214c6788c6dc2b18856f37)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:05.848730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:05.874866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d7a390e4b84b51b6d78b844cf41ce5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.875804 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d7a390e4b84b51b6d78b844cf41ce5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.891964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d7a390e4b84b51b6d78b844cf41ce5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.894713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:05.903366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d7a390e4b84b51b6d78b844cf41ce5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.904081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f843f11f-047f-4448-a12e-fd1cee0c965d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d7a390e4b84b51b6d78b844cf41ce5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.926548 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1096/2200] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:05 2022] DELETE /identity/v3/users/a9d7a390e4b84b51b6d78b844cf41ce5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:05.931118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5b33f-4dfb-425a-a79b-c6fb989a3c5e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:05.931697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5b33f-4dfb-425a-a79b-c6fb989a3c5e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:05.931975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5b33f-4dfb-425a-a79b-c6fb989a3c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:05.936829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d95ab48f7214c6788c6dc2b18856f37', 'request_id': 'req-804c5df8-3c75-4d79-868b-b06e6d44430e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.958888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d95ab48f7214c6788c6dc2b18856f37', 'request_id': 'req-804c5df8-3c75-4d79-868b-b06e6d44430e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.959745 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-19c5b33f-4dfb-425a-a79b-c6fb989a3c5e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:05.960984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-19c5b33f-4dfb-425a-a79b-c6fb989a3c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:05.966489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:05.968028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d95ab48f7214c6788c6dc2b18856f37', 'request_id': 'req-804c5df8-3c75-4d79-868b-b06e6d44430e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.986900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] The token cache is being invalidate because project 2d95ab48f7214c6788c6dc2b18856f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:05.987452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.988005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-804c5df8-3c75-4d79-868b-b06e6d44430e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:05.992932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1105/2201] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:05 2022] DELETE /identity/v3/projects/2d95ab48f7214c6788c6dc2b18856f37 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:36:05.994593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0474-77bb-448c-9380-16af18673535 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:05.995281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0474-77bb-448c-9380-16af18673535 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:05.995566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0474-77bb-448c-9380-16af18673535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.017337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d8eb0474-77bb-448c-9380-16af18673535 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:06.018580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d8eb0474-77bb-448c-9380-16af18673535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:06.031327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1097/2202] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:36:06.043495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5b33f-4dfb-425a-a79b-c6fb989a3c5e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:06.044933 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-19c5b33f-4dfb-425a-a79b-c6fb989a3c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:06.095423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1106/2203] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:06.104963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e87933-2d7a-421a-a357-a28b2bca66cf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.105539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e87933-2d7a-421a-a357-a28b2bca66cf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.106187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e87933-2d7a-421a-a357-a28b2bca66cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.109496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5b33f-4dfb-425a-a79b-c6fb989a3c5e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:06.113282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd288-ef63-42c6-b90b-f33c475617cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:06.114295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd288-ef63-42c6-b90b-f33c475617cb service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.114807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd288-ef63-42c6-b90b-f33c475617cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.115233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd288-ef63-42c6-b90b-f33c475617cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.125254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebd288-ef63-42c6-b90b-f33c475617cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:06.126713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebd288-ef63-42c6-b90b-f33c475617cb service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:06.132359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-95e87933-2d7a-421a-a357-a28b2bca66cf None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:06.133896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-95e87933-2d7a-421a-a357-a28b2bca66cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:06.138647 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1098/2204] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:36:06.144779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1107/2205] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:36:06.146109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd288-ef63-42c6-b90b-f33c475617cb service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:06.155688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd288-ef63-42c6-b90b-f33c475617cb service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:06.160869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a545b-e530-4bec-ae1a-fed9c1ce2ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:06.161469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a545b-e530-4bec-ae1a-fed9c1ce2ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.161745 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a545b-e530-4bec-ae1a-fed9c1ce2ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.162015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a545b-e530-4bec-ae1a-fed9c1ce2ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.163221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a545b-e530-4bec-ae1a-fed9c1ce2ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:06.163530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a545b-e530-4bec-ae1a-fed9c1ce2ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:06.165121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a545b-e530-4bec-ae1a-fed9c1ce2ef1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:06.182072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1099/2206] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:06.186441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e87933-2d7a-421a-a357-a28b2bca66cf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:06.196597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e87933-2d7a-421a-a357-a28b2bca66cf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:06.201235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2034c-350c-42c2-8cee-73d680b235d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:06.201835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2034c-350c-42c2-8cee-73d680b235d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.202117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2034c-350c-42c2-8cee-73d680b235d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.202390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2034c-350c-42c2-8cee-73d680b235d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.203052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2034c-350c-42c2-8cee-73d680b235d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:06.204966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2034c-350c-42c2-8cee-73d680b235d5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:06.236799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1108/2207] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:36:06 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:06.241623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a545b-e530-4bec-ae1a-fed9c1ce2ef1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:06.257529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a545b-e530-4bec-ae1a-fed9c1ce2ef1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:06.331885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9bf72-2341-4bc6-ace5-5b9bd0c57664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:06.332542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9bf72-2341-4bc6-ace5-5b9bd0c57664 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.332821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9bf72-2341-4bc6-ace5-5b9bd0c57664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.333091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9bf72-2341-4bc6-ace5-5b9bd0c57664 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.333748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9bf72-2341-4bc6-ace5-5b9bd0c57664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:06.335789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9bf72-2341-4bc6-ace5-5b9bd0c57664 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:06.361720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1100/2208] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:36:06 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:06.366149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2034c-350c-42c2-8cee-73d680b235d5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:06.378596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2034c-350c-42c2-8cee-73d680b235d5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:06.385851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf3161-c155-488e-a5c5-5cd3384f998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:06.387217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf3161-c155-488e-a5c5-5cd3384f998c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.387663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf3161-c155-488e-a5c5-5cd3384f998c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.388474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf3161-c155-488e-a5c5-5cd3384f998c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.389135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf3161-c155-488e-a5c5-5cd3384f998c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:06.390968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf3161-c155-488e-a5c5-5cd3384f998c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:06.406388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1109/2209] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:36:06.408130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9bf72-2341-4bc6-ace5-5b9bd0c57664 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:06.436101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9bf72-2341-4bc6-ace5-5b9bd0c57664 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:06.445305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7222-8ec9-41a5-899f-2aa63325520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:06.446361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7222-8ec9-41a5-899f-2aa63325520c admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.446888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7222-8ec9-41a5-899f-2aa63325520c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.447370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7222-8ec9-41a5-899f-2aa63325520c admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.448239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d7222-8ec9-41a5-899f-2aa63325520c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:06.450064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d7222-8ec9-41a5-899f-2aa63325520c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:06.478463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1101/2210] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:36:06.479734 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf3161-c155-488e-a5c5-5cd3384f998c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:06.490860 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf3161-c155-488e-a5c5-5cd3384f998c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:06.496650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d0ba4-3b7b-4939-88be-78e12f33ac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:06.497429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0ba4-3b7b-4939-88be-78e12f33ac90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.497709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0ba4-3b7b-4939-88be-78e12f33ac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.497984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0ba4-3b7b-4939-88be-78e12f33ac90 admin admin] PATH_INFO: `/v3/projects/743bb95a282f4fb6a86d65bcbce9f2c7/users/a73b6258e8ce422cad0e97a2ec139742/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.526264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d0ba4-3b7b-4939-88be-78e12f33ac90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743bb95a282f4fb6a86d65bcbce9f2c7, user_id=a73b6258e8ce422cad0e97a2ec139742, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:06.530043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d0ba4-3b7b-4939-88be-78e12f33ac90 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:06.554510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7222-8ec9-41a5-899f-2aa63325520c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:06.557862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d36d7222-8ec9-41a5-899f-2aa63325520c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:06.578780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1110/2211] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:06 2022] PUT /identity/v3/projects/743bb95a282f4fb6a86d65bcbce9f2c7/users/a73b6258e8ce422cad0e97a2ec139742/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:36:06.596687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7222-8ec9-41a5-899f-2aa63325520c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:06.598869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b934-7f01-4593-9cfe-712c7eca5f45 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.599182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b934-7f01-4593-9cfe-712c7eca5f45 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.599462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b934-7f01-4593-9cfe-712c7eca5f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.626929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:06.658713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b2f5b934-7f01-4593-9cfe-712c7eca5f45 None None] MFA Rules not processed for user `a73b6258e8ce422cad0e97a2ec139742`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:06.659937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b2f5b934-7f01-4593-9cfe-712c7eca5f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:06.718526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:06.719677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.719962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.720512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] PATH_INFO: `/v3/projects/6695333e92bb49458403d43cd408e876` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.721709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6695333e92bb49458403d43cd408e876)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:06.723719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:06.738426 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:06.776452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1111/2212] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:06.785949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6695333e92bb49458403d43cd408e876', 'request_id': 'req-0e60d3a9-5b19-4527-a978-7c1a907b82fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:06.792425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b934-7f01-4593-9cfe-712c7eca5f45 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:06.793979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6695333e92bb49458403d43cd408e876', 'request_id': 'req-0e60d3a9-5b19-4527-a978-7c1a907b82fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:06.795298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b2f5b934-7f01-4593-9cfe-712c7eca5f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:06.812976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6695333e92bb49458403d43cd408e876', 'request_id': 'req-0e60d3a9-5b19-4527-a978-7c1a907b82fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:06.832681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] The token cache is being invalidate because project 6695333e92bb49458403d43cd408e876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:06.833017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:06.833786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:06.840581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1102/2213] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:06 2022] DELETE /identity/v3/projects/6695333e92bb49458403d43cd408e876 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:36:06.841834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:06.843848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:06.885636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b934-7f01-4593-9cfe-712c7eca5f45 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:06.961841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc4801-44ae-4631-9afb-e89a9b5b7408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:06.962716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc4801-44ae-4631-9afb-e89a9b5b7408 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:06.963101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc4801-44ae-4631-9afb-e89a9b5b7408 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:06.963470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc4801-44ae-4631-9afb-e89a9b5b7408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:06.965696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cfbc4801-44ae-4631-9afb-e89a9b5b7408 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:06.991432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60d3a9-5b19-4527-a978-7c1a907b82fb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:06.999401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:07.000128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:07.000477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:07.000755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] PATH_INFO: `/v3/users/a0d88c67860b49c7aed505c73f67ee97` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:07.002195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d88c67860b49c7aed505c73f67ee97)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:07.004509 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:07.086724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d88c67860b49c7aed505c73f67ee97'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:07.087532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d88c67860b49c7aed505c73f67ee97'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:07.092800 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:07.098835 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc4801-44ae-4631-9afb-e89a9b5b7408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:07.101156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc4801-44ae-4631-9afb-e89a9b5b7408 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:07.108353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d88c67860b49c7aed505c73f67ee97'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:07.112166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1112/2214] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:07.129321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d88c67860b49c7aed505c73f67ee97'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:07.130021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7413aa30-b33e-4b93-82ed-101a6dc87633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d88c67860b49c7aed505c73f67ee97'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:07.157455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1103/2215] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:06 2022] DELETE /identity/v3/users/a0d88c67860b49c7aed505c73f67ee97 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:07.500260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc4801-44ae-4631-9afb-e89a9b5b7408 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:07.517049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc4801-44ae-4631-9afb-e89a9b5b7408 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:07.584719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:07.594449 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:07.595155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:07.595434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:07.595702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] PATH_INFO: `/v3/projects/100ba7a6180d4cbeb046c1d24e6384e0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:07.596838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100ba7a6180d4cbeb046c1d24e6384e0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:07.598778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:07.647841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100ba7a6180d4cbeb046c1d24e6384e0', 'request_id': 'req-e40a9c00-f917-448f-917e-f67e812ec8e0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:07.654147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100ba7a6180d4cbeb046c1d24e6384e0', 'request_id': 'req-e40a9c00-f917-448f-917e-f67e812ec8e0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:07.661204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100ba7a6180d4cbeb046c1d24e6384e0', 'request_id': 'req-e40a9c00-f917-448f-917e-f67e812ec8e0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:07.674261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] The token cache is being invalidate because project 100ba7a6180d4cbeb046c1d24e6384e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:07.674553 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:07.675218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e40a9c00-f917-448f-917e-f67e812ec8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:07.676696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1113/2216] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:07 2022] DELETE /identity/v3/projects/100ba7a6180d4cbeb046c1d24e6384e0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:07.681687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d5369-fe11-4e75-a211-994d2255a3ee None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:07.681973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d5369-fe11-4e75-a211-994d2255a3ee None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:07.682262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d5369-fe11-4e75-a211-994d2255a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:07.703412 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-117d5369-fe11-4e75-a211-994d2255a3ee None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:07.712974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-117d5369-fe11-4e75-a211-994d2255a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:07.777474 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1104/2217] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:07.785899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b6360-4de5-43ae-8b7e-502163db7dac None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:07.786183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b6360-4de5-43ae-8b7e-502163db7dac None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:07.786454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b6360-4de5-43ae-8b7e-502163db7dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:07.808343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-208b6360-4de5-43ae-8b7e-502163db7dac None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:07.809570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-208b6360-4de5-43ae-8b7e-502163db7dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:07.817585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1114/2218] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:07.822372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d5369-fe11-4e75-a211-994d2255a3ee None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:07.833634 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d5369-fe11-4e75-a211-994d2255a3ee None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:07.838512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61f43f-65d3-48c8-a4ff-a3ea317a4ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:07.839156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61f43f-65d3-48c8-a4ff-a3ea317a4ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:07.839429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61f43f-65d3-48c8-a4ff-a3ea317a4ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:07.839697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61f43f-65d3-48c8-a4ff-a3ea317a4ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:07.840346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61f43f-65d3-48c8-a4ff-a3ea317a4ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:07.840648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61f43f-65d3-48c8-a4ff-a3ea317a4ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:07.842274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61f43f-65d3-48c8-a4ff-a3ea317a4ab6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:07.854639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1105/2219] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:36:07.859143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b6360-4de5-43ae-8b7e-502163db7dac None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:07.869231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b6360-4de5-43ae-8b7e-502163db7dac None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:07.874264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cdd4a-3406-41f6-84ca-59494ad0397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:07.874884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cdd4a-3406-41f6-84ca-59494ad0397c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:07.875162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cdd4a-3406-41f6-84ca-59494ad0397c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:07.875435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cdd4a-3406-41f6-84ca-59494ad0397c admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:07.876059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cdd4a-3406-41f6-84ca-59494ad0397c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:07.877964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cdd4a-3406-41f6-84ca-59494ad0397c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:07.909503 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1115/2220] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:36:07 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:07.910947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61f43f-65d3-48c8-a4ff-a3ea317a4ab6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:07.921832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61f43f-65d3-48c8-a4ff-a3ea317a4ab6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:07.987277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81aa4e4-1901-4ee4-b0aa-be2596d0743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:07.987890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81aa4e4-1901-4ee4-b0aa-be2596d0743f admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:07.988171 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81aa4e4-1901-4ee4-b0aa-be2596d0743f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:07.988440 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81aa4e4-1901-4ee4-b0aa-be2596d0743f admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:07.989091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81aa4e4-1901-4ee4-b0aa-be2596d0743f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:07.992426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81aa4e4-1901-4ee4-b0aa-be2596d0743f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:08.014003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1106/2221] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:36:07 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:36:08.018303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cdd4a-3406-41f6-84ca-59494ad0397c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:08.029099 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cdd4a-3406-41f6-84ca-59494ad0397c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:08.034048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869eb4eb-5e0a-4d26-80ee-f3959063b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:08.034751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869eb4eb-5e0a-4d26-80ee-f3959063b7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.035119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869eb4eb-5e0a-4d26-80ee-f3959063b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.035454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869eb4eb-5e0a-4d26-80ee-f3959063b7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.036166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869eb4eb-5e0a-4d26-80ee-f3959063b7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:08.038595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869eb4eb-5e0a-4d26-80ee-f3959063b7e7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:08.050145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1116/2222] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:08.054803 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81aa4e4-1901-4ee4-b0aa-be2596d0743f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:08.066177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81aa4e4-1901-4ee4-b0aa-be2596d0743f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:08.072561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2392a7-448e-44dd-8f6d-552fa4720bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:08.073251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2392a7-448e-44dd-8f6d-552fa4720bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.073598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2392a7-448e-44dd-8f6d-552fa4720bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.073941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2392a7-448e-44dd-8f6d-552fa4720bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.075563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2392a7-448e-44dd-8f6d-552fa4720bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:08.076918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2392a7-448e-44dd-8f6d-552fa4720bf9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:08.103469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1107/2223] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:08.104822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869eb4eb-5e0a-4d26-80ee-f3959063b7e7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:08.115870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869eb4eb-5e0a-4d26-80ee-f3959063b7e7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:08.137071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efbbff-ceef-4b05-bc38-cde3561f13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:08.137919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efbbff-ceef-4b05-bc38-cde3561f13d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.138234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efbbff-ceef-4b05-bc38-cde3561f13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.138504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efbbff-ceef-4b05-bc38-cde3561f13d0 admin admin] PATH_INFO: `/v3/projects/dc81cd7450234544b08cc9dfa349db95/users/8a652a5d08374cc7a2418e6664422815/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.159372 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efbbff-ceef-4b05-bc38-cde3561f13d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc81cd7450234544b08cc9dfa349db95, user_id=8a652a5d08374cc7a2418e6664422815, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:08.168428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efbbff-ceef-4b05-bc38-cde3561f13d0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:08.184065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1117/2224] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:08 2022] PUT /identity/v3/projects/dc81cd7450234544b08cc9dfa349db95/users/8a652a5d08374cc7a2418e6664422815/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:08.195524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36b323-648d-4b42-a9cd-ab0a52609a57 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.195801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36b323-648d-4b42-a9cd-ab0a52609a57 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.196070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36b323-648d-4b42-a9cd-ab0a52609a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.228176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bf36b323-648d-4b42-a9cd-ab0a52609a57 None None] MFA Rules not processed for user `8a652a5d08374cc7a2418e6664422815`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:08.229741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bf36b323-648d-4b42-a9cd-ab0a52609a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:08.265449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:08.310244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1108/2225] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:08.315179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efbbff-ceef-4b05-bc38-cde3561f13d0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:08.379924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efbbff-ceef-4b05-bc38-cde3561f13d0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:08.386407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb00bdf-292e-4a46-9c71-57af76a92747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:08.387078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00bdf-292e-4a46-9c71-57af76a92747 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.387362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00bdf-292e-4a46-9c71-57af76a92747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.387785 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00bdf-292e-4a46-9c71-57af76a92747 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.388434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb00bdf-292e-4a46-9c71-57af76a92747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:08.390361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb00bdf-292e-4a46-9c71-57af76a92747 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:08.419022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1118/2226] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:36:08 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:08.423018 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36b323-648d-4b42-a9cd-ab0a52609a57 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:08.433601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36b323-648d-4b42-a9cd-ab0a52609a57 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:08.492873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd22840-2a66-474a-a253-de9738cf8959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:08.493564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd22840-2a66-474a-a253-de9738cf8959 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.493841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd22840-2a66-474a-a253-de9738cf8959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.494111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd22840-2a66-474a-a253-de9738cf8959 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.494765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd22840-2a66-474a-a253-de9738cf8959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:08.496672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd22840-2a66-474a-a253-de9738cf8959 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:08.520960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1109/2227] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:36:08 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:08.522710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb00bdf-292e-4a46-9c71-57af76a92747 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:08.529176 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:08.533573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb00bdf-292e-4a46-9c71-57af76a92747 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:08.551451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978a3aa-d8f1-44b5-b147-45a29e14fb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:08.552092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978a3aa-d8f1-44b5-b147-45a29e14fb48 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.552598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978a3aa-d8f1-44b5-b147-45a29e14fb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.553044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978a3aa-d8f1-44b5-b147-45a29e14fb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.553971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978a3aa-d8f1-44b5-b147-45a29e14fb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:08.555683 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978a3aa-d8f1-44b5-b147-45a29e14fb48 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:08.571342 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1119/2228] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:08.572680 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd22840-2a66-474a-a253-de9738cf8959 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:08.583926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd22840-2a66-474a-a253-de9738cf8959 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:08.590106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437141-50f8-4cbf-b664-4e622220d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:08.590858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437141-50f8-4cbf-b664-4e622220d752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.591140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437141-50f8-4cbf-b664-4e622220d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.591413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437141-50f8-4cbf-b664-4e622220d752 admin admin] PATH_INFO: `/v3/projects/5c9d9a50c6d849ebb6293d260ebf50be/users/cfec9c859f2b480cbd041f38d4309c9e/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.606940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f437141-50f8-4cbf-b664-4e622220d752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9d9a50c6d849ebb6293d260ebf50be, user_id=cfec9c859f2b480cbd041f38d4309c9e, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:08.609742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f437141-50f8-4cbf-b664-4e622220d752 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:08.623244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1110/2229] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:08 2022] PUT /identity/v3/projects/5c9d9a50c6d849ebb6293d260ebf50be/users/cfec9c859f2b480cbd041f38d4309c9e/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:08.627336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978a3aa-d8f1-44b5-b147-45a29e14fb48 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:08.638031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978a3aa-d8f1-44b5-b147-45a29e14fb48 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:08.696667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30a2cb-86bd-44d1-977c-7021a0855981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:08.697291 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a2cb-86bd-44d1-977c-7021a0855981 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.697579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a2cb-86bd-44d1-977c-7021a0855981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.697855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a2cb-86bd-44d1-977c-7021a0855981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.698508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30a2cb-86bd-44d1-977c-7021a0855981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:08.700500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30a2cb-86bd-44d1-977c-7021a0855981 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:08.712759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1120/2230] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:08.717320 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437141-50f8-4cbf-b664-4e622220d752 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:08.730701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437141-50f8-4cbf-b664-4e622220d752 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:08.736946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9411ec-43ea-49a7-b72f-e38751b326e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:08.737757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9411ec-43ea-49a7-b72f-e38751b326e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.737923 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9411ec-43ea-49a7-b72f-e38751b326e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.738157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9411ec-43ea-49a7-b72f-e38751b326e5 admin admin] PATH_INFO: `/v3/projects/5c9d9a50c6d849ebb6293d260ebf50be/users/cfec9c859f2b480cbd041f38d4309c9e/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.741544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9411ec-43ea-49a7-b72f-e38751b326e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9d9a50c6d849ebb6293d260ebf50be, user_id=cfec9c859f2b480cbd041f38d4309c9e, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:08.746360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9411ec-43ea-49a7-b72f-e38751b326e5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:08.761364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1111/2231] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:08 2022] PUT /identity/v3/projects/5c9d9a50c6d849ebb6293d260ebf50be/users/cfec9c859f2b480cbd041f38d4309c9e/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:08.780607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3d36e-beb8-41d9-8f96-ac91f37bf094 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.780899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3d36e-beb8-41d9-8f96-ac91f37bf094 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.781692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3d36e-beb8-41d9-8f96-ac91f37bf094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.784829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff6e5-5d6d-4f3c-9c41-c2339300d67a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:08.784829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff6e5-5d6d-4f3c-9c41-c2339300d67a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:08.784829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff6e5-5d6d-4f3c-9c41-c2339300d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:08.806519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6a2ff6e5-5d6d-4f3c-9c41-c2339300d67a None None] MFA Rules not processed for user `9c6351ae09844bd1aba6b0dff3d6ae27`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:08.807766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6a2ff6e5-5d6d-4f3c-9c41-c2339300d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:08.830153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f2d3d36e-beb8-41d9-8f96-ac91f37bf094 None None] MFA Rules not processed for user `cfec9c859f2b480cbd041f38d4309c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:08.831469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f2d3d36e-beb8-41d9-8f96-ac91f37bf094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:08.886410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1112/2232] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:08.919763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1121/2233] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:08.932320 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ff6e5-5d6d-4f3c-9c41-c2339300d67a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:08.933959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6a2ff6e5-5d6d-4f3c-9c41-c2339300d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:08.972279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:09.024252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ff6e5-5d6d-4f3c-9c41-c2339300d67a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:09.028909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928673-7eab-4f1b-af62-0432e4c60770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:09.029512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928673-7eab-4f1b-af62-0432e4c60770 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:09.029786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928673-7eab-4f1b-af62-0432e4c60770 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:09.030052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928673-7eab-4f1b-af62-0432e4c60770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:09.041441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928673-7eab-4f1b-af62-0432e4c60770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:09.044129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928673-7eab-4f1b-af62-0432e4c60770 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:09.066376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1113/2234] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:09.212130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3d36e-beb8-41d9-8f96-ac91f37bf094 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:09.213821 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f2d3d36e-beb8-41d9-8f96-ac91f37bf094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:09.233182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3d36e-beb8-41d9-8f96-ac91f37bf094 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:09.239085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8e720-defa-4e31-80bb-25a535d091a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:09.239728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8e720-defa-4e31-80bb-25a535d091a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:09.240008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8e720-defa-4e31-80bb-25a535d091a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:09.240335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8e720-defa-4e31-80bb-25a535d091a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:09.329608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8e720-defa-4e31-80bb-25a535d091a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:09.331886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8e720-defa-4e31-80bb-25a535d091a8 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:09.343863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1122/2235] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:12.262980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928673-7eab-4f1b-af62-0432e4c60770 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:12.343589 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928673-7eab-4f1b-af62-0432e4c60770 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:12.347953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:12.348682 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:12.348962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:12.349248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] PATH_INFO: `/v3/users/8a652a5d08374cc7a2418e6664422815` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:12.350911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a652a5d08374cc7a2418e6664422815)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:12.352816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:12.405850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a652a5d08374cc7a2418e6664422815'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:12.406516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a652a5d08374cc7a2418e6664422815'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:12.422580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a652a5d08374cc7a2418e6664422815'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:12.431841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a652a5d08374cc7a2418e6664422815'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:12.432575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a652a5d08374cc7a2418e6664422815'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:12.452003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1114/2236] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:12 2022] DELETE /identity/v3/users/8a652a5d08374cc7a2418e6664422815 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:12.457188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b566b-7675-4b71-8e7e-c171869be2f4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:12.458068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b566b-7675-4b71-8e7e-c171869be2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:12.458350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b566b-7675-4b71-8e7e-c171869be2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:12.502325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a17b566b-7675-4b71-8e7e-c171869be2f4 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:12.503898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a17b566b-7675-4b71-8e7e-c171869be2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:12.516322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:12.576333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1123/2237] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:12.586837 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:12.588353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:12.652546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:12.668984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8f6c2-7788-4887-9d05-cb19b7d20415 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:12.674911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fee47-cc18-4b54-a4af-e4d270a849b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:12.675395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fee47-cc18-4b54-a4af-e4d270a849b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:12.675742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fee47-cc18-4b54-a4af-e4d270a849b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:12.676077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fee47-cc18-4b54-a4af-e4d270a849b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:12.687489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fee47-cc18-4b54-a4af-e4d270a849b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:12.689350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fee47-cc18-4b54-a4af-e4d270a849b6 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:12.701968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1115/2238] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:13.253358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b566b-7675-4b71-8e7e-c171869be2f4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:13.254889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a17b566b-7675-4b71-8e7e-c171869be2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:13.273010 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b566b-7675-4b71-8e7e-c171869be2f4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:13.278508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:13.279281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:13.279615 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:13.279891 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] PATH_INFO: `/v3/projects/dc81cd7450234544b08cc9dfa349db95` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:13.281472 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc81cd7450234544b08cc9dfa349db95)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:13.283533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:13.380359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc81cd7450234544b08cc9dfa349db95', 'request_id': 'req-ef414cbd-5748-4f84-9854-ef6d0bb100d3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:13.389399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc81cd7450234544b08cc9dfa349db95', 'request_id': 'req-ef414cbd-5748-4f84-9854-ef6d0bb100d3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:13.397275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc81cd7450234544b08cc9dfa349db95', 'request_id': 'req-ef414cbd-5748-4f84-9854-ef6d0bb100d3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:13.412214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] The token cache is being invalidate because project dc81cd7450234544b08cc9dfa349db95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:13.412711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:13.413688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:13.415440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1124/2239] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:13 2022] DELETE /identity/v3/projects/dc81cd7450234544b08cc9dfa349db95 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:13.419627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fee47-cc18-4b54-a4af-e4d270a849b6 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:13.430431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fee47-cc18-4b54-a4af-e4d270a849b6 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:13.495818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:13.496621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:13.496905 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:13.497199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] PATH_INFO: `/v3/users/cfec9c859f2b480cbd041f38d4309c9e` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:13.498423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfec9c859f2b480cbd041f38d4309c9e)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:13.500514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:13.552020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfec9c859f2b480cbd041f38d4309c9e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:13.553377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfec9c859f2b480cbd041f38d4309c9e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:13.570723 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfec9c859f2b480cbd041f38d4309c9e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:13.598025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfec9c859f2b480cbd041f38d4309c9e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:13.599897 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-64e9b671-1867-40a5-aca9-7a1febd0731a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfec9c859f2b480cbd041f38d4309c9e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:13.618278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1116/2240] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:13 2022] DELETE /identity/v3/users/cfec9c859f2b480cbd041f38d4309c9e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:13.916526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:13.918083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:13.938104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef414cbd-5748-4f84-9854-ef6d0bb100d3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:14.003245 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:14.004489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.004774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.005047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] PATH_INFO: `/v3/projects/5c9d9a50c6d849ebb6293d260ebf50be` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.006244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9d9a50c6d849ebb6293d260ebf50be)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:14.008199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:14.050906 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:14.060744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9d9a50c6d849ebb6293d260ebf50be', 'request_id': 'req-5caaccd0-b401-49a6-840d-1c4768442f94'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:14.066947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9d9a50c6d849ebb6293d260ebf50be', 'request_id': 'req-5caaccd0-b401-49a6-840d-1c4768442f94'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:14.074796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9d9a50c6d849ebb6293d260ebf50be', 'request_id': 'req-5caaccd0-b401-49a6-840d-1c4768442f94'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:14.094765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] The token cache is being invalidate because project 5c9d9a50c6d849ebb6293d260ebf50be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:14.095510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:14.096194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caaccd0-b401-49a6-840d-1c4768442f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:14.101729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1125/2241] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:13 2022] DELETE /identity/v3/projects/5c9d9a50c6d849ebb6293d260ebf50be => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:14.103026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc715-7a6e-4a1c-b965-8166f3542c15 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.103313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc715-7a6e-4a1c-b965-8166f3542c15 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.103587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc715-7a6e-4a1c-b965-8166f3542c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.147746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-70edc715-7a6e-4a1c-b965-8166f3542c15 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:14.148970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-70edc715-7a6e-4a1c-b965-8166f3542c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:14.236705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1117/2242] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:14.245105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4048-5e43-4f22-84c4-e21544c33079 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.245478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4048-5e43-4f22-84c4-e21544c33079 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.245821 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4048-5e43-4f22-84c4-e21544c33079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.267022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6b8c4048-5e43-4f22-84c4-e21544c33079 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:14.268413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6b8c4048-5e43-4f22-84c4-e21544c33079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:14.279772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1126/2243] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:14.284195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edc715-7a6e-4a1c-b965-8166f3542c15 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:14.295453 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edc715-7a6e-4a1c-b965-8166f3542c15 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:14.300432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368af5a-0989-4312-8639-25ee993ae730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:14.301125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368af5a-0989-4312-8639-25ee993ae730 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.301480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368af5a-0989-4312-8639-25ee993ae730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.301826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368af5a-0989-4312-8639-25ee993ae730 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.303151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368af5a-0989-4312-8639-25ee993ae730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:14.303530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368af5a-0989-4312-8639-25ee993ae730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:14.305310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368af5a-0989-4312-8639-25ee993ae730 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:14.307357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:14.324119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1118/2244] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:14.329246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c4048-5e43-4f22-84c4-e21544c33079 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:14.339844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c4048-5e43-4f22-84c4-e21544c33079 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:14.346510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d07200-97dd-40e5-b975-3086e419afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:14.347203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d07200-97dd-40e5-b975-3086e419afa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.347478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d07200-97dd-40e5-b975-3086e419afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.347745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d07200-97dd-40e5-b975-3086e419afa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.348370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d07200-97dd-40e5-b975-3086e419afa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:14.351212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d07200-97dd-40e5-b975-3086e419afa6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:14.380039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1127/2245] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:36:14 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:14.384533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368af5a-0989-4312-8639-25ee993ae730 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:14.402032 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368af5a-0989-4312-8639-25ee993ae730 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:14.473396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd2428-b40e-4d87-b43f-af3aba7574ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:14.474090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2428-b40e-4d87-b43f-af3aba7574ec admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.475049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2428-b40e-4d87-b43f-af3aba7574ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.475361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2428-b40e-4d87-b43f-af3aba7574ec admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.476068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd2428-b40e-4d87-b43f-af3aba7574ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:14.478807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd2428-b40e-4d87-b43f-af3aba7574ec admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:14.500980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1119/2246] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:36:14 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:36:14.505228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d07200-97dd-40e5-b975-3086e419afa6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:14.515926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d07200-97dd-40e5-b975-3086e419afa6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:14.520585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f35d8d-ba4e-4c90-af05-977def7a6940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:14.521272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f35d8d-ba4e-4c90-af05-977def7a6940 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.521548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f35d8d-ba4e-4c90-af05-977def7a6940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.521818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f35d8d-ba4e-4c90-af05-977def7a6940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.522457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f35d8d-ba4e-4c90-af05-977def7a6940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:14.524074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f35d8d-ba4e-4c90-af05-977def7a6940 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:14.534212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1128/2247] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:14.538834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd2428-b40e-4d87-b43f-af3aba7574ec admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:14.548657 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd2428-b40e-4d87-b43f-af3aba7574ec admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:14.553987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5569ff-c3df-4c88-ac3a-1af0667e0eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:14.554581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5569ff-c3df-4c88-ac3a-1af0667e0eed admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.554870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5569ff-c3df-4c88-ac3a-1af0667e0eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.555139 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5569ff-c3df-4c88-ac3a-1af0667e0eed admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.555775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5569ff-c3df-4c88-ac3a-1af0667e0eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:14.557335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5569ff-c3df-4c88-ac3a-1af0667e0eed admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:14.567795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1120/2248] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:14.572894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f35d8d-ba4e-4c90-af05-977def7a6940 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:14.586264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f35d8d-ba4e-4c90-af05-977def7a6940 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:14.590933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb342e-5c92-47bf-b080-e12cbed620b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:14.591577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb342e-5c92-47bf-b080-e12cbed620b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.591857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb342e-5c92-47bf-b080-e12cbed620b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.592132 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb342e-5c92-47bf-b080-e12cbed620b6 admin admin] PATH_INFO: `/v3/projects/dee374c6283748d0af5c70afa61b10f9/users/fe7c7d0e22094ffea57636a2afaebae6/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.609752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb342e-5c92-47bf-b080-e12cbed620b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee374c6283748d0af5c70afa61b10f9, user_id=fe7c7d0e22094ffea57636a2afaebae6, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:14.612292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb342e-5c92-47bf-b080-e12cbed620b6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:14.627007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1129/2249] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:14 2022] PUT /identity/v3/projects/dee374c6283748d0af5c70afa61b10f9/users/fe7c7d0e22094ffea57636a2afaebae6/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:14.632328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123846e-a544-44cb-b5e2-3c514fb94a83 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.632634 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123846e-a544-44cb-b5e2-3c514fb94a83 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.633166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123846e-a544-44cb-b5e2-3c514fb94a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.653585 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d123846e-a544-44cb-b5e2-3c514fb94a83 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:14.654863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d123846e-a544-44cb-b5e2-3c514fb94a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:14.727540 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1121/2250] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:36:14.739056 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb342e-5c92-47bf-b080-e12cbed620b6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:14.741173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fabb342e-5c92-47bf-b080-e12cbed620b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:14.824077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb342e-5c92-47bf-b080-e12cbed620b6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:14.827765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c849ef-54d7-4da1-92f3-c6e7469ac230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:14.828367 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c849ef-54d7-4da1-92f3-c6e7469ac230 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:14.828649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c849ef-54d7-4da1-92f3-c6e7469ac230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:14.828923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c849ef-54d7-4da1-92f3-c6e7469ac230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:14.842874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c849ef-54d7-4da1-92f3-c6e7469ac230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:14.842874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c849ef-54d7-4da1-92f3-c6e7469ac230 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:14.849871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1130/2251] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:15.692186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a72dc-45f0-4a97-8893-9d1eefd36dfb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:15.693272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a72dc-45f0-4a97-8893-9d1eefd36dfb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:15.693808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a72dc-45f0-4a97-8893-9d1eefd36dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:15.739338 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-669a72dc-45f0-4a97-8893-9d1eefd36dfb None None] MFA Rules not processed for user `fe7c7d0e22094ffea57636a2afaebae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:15.739338 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-669a72dc-45f0-4a97-8893-9d1eefd36dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:15.869797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1122/2252] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:15.874504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c849ef-54d7-4da1-92f3-c6e7469ac230 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:15.888575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a72dc-45f0-4a97-8893-9d1eefd36dfb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:15.889679 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c849ef-54d7-4da1-92f3-c6e7469ac230 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:15.890187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-669a72dc-45f0-4a97-8893-9d1eefd36dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:15.899811 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:15.901416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f00b0-ffba-4464-87f5-9935ef48b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:15.906050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f00b0-ffba-4464-87f5-9935ef48b24c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:15.906385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f00b0-ffba-4464-87f5-9935ef48b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:15.906664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f00b0-ffba-4464-87f5-9935ef48b24c admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:15.909896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a72dc-45f0-4a97-8893-9d1eefd36dfb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:15.911464 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f00b0-ffba-4464-87f5-9935ef48b24c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:15.913741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f00b0-ffba-4464-87f5-9935ef48b24c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:15.916230 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:15.917033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:15.917489 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:15.917910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] PATH_INFO: `/v3/users/85640328abfb4f6094bff577d4979a62` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:15.920229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=85640328abfb4f6094bff577d4979a62)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:15.927472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:15.957152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1131/2253] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:36:15 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:15.962093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f00b0-ffba-4464-87f5-9935ef48b24c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:15.996806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85640328abfb4f6094bff577d4979a62'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:15.997889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85640328abfb4f6094bff577d4979a62'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:16.017845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85640328abfb4f6094bff577d4979a62'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:16.038628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85640328abfb4f6094bff577d4979a62'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:16.039608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-07bdff18-4bec-4e1d-a5d8-741829e840dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85640328abfb4f6094bff577d4979a62'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:16.042800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:16.058959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1123/2254] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:15 2022] DELETE /identity/v3/users/85640328abfb4f6094bff577d4979a62 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:16.063669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c73b2-b50c-46a3-9371-1bdd0a58a39b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:16.063986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c73b2-b50c-46a3-9371-1bdd0a58a39b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:16.064265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c73b2-b50c-46a3-9371-1bdd0a58a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:16.070699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f00b0-ffba-4464-87f5-9935ef48b24c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:16.084968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-be4c73b2-b50c-46a3-9371-1bdd0a58a39b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:16.086187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-be4c73b2-b50c-46a3-9371-1bdd0a58a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:16.141675 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed4687-1ae7-4752-86c2-9887e25557ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:16.142347 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed4687-1ae7-4752-86c2-9887e25557ca admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:16.142665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed4687-1ae7-4752-86c2-9887e25557ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:16.143002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed4687-1ae7-4752-86c2-9887e25557ca admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:16.143636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed4687-1ae7-4752-86c2-9887e25557ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:16.145627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed4687-1ae7-4752-86c2-9887e25557ca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:16.155442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1124/2255] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:36:16.165994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c73b2-b50c-46a3-9371-1bdd0a58a39b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:16.179138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-be4c73b2-b50c-46a3-9371-1bdd0a58a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:16.186161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1132/2256] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:36:15 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:16.187421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed4687-1ae7-4752-86c2-9887e25557ca admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:16.190217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-30ed4687-1ae7-4752-86c2-9887e25557ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:16.206940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed4687-1ae7-4752-86c2-9887e25557ca admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:16.212697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976da1bc-e0a0-4fbe-90de-376f5cfc3dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:16.213311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976da1bc-e0a0-4fbe-90de-376f5cfc3dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:16.213593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976da1bc-e0a0-4fbe-90de-376f5cfc3dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:16.214014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976da1bc-e0a0-4fbe-90de-376f5cfc3dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:16.214666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976da1bc-e0a0-4fbe-90de-376f5cfc3dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:16.216721 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976da1bc-e0a0-4fbe-90de-376f5cfc3dd5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:16.238380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1133/2257] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:36:16.248222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976da1bc-e0a0-4fbe-90de-376f5cfc3dd5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:16.260567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c73b2-b50c-46a3-9371-1bdd0a58a39b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:16.260824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976da1bc-e0a0-4fbe-90de-376f5cfc3dd5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:16.266175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bc4b9-e549-4a18-882f-6451a6f68bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:16.266838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bc4b9-e549-4a18-882f-6451a6f68bca service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:16.267194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bc4b9-e549-4a18-882f-6451a6f68bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:16.267510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc998-0d7d-484a-af98-75675f2f9e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:16.267632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bc4b9-e549-4a18-882f-6451a6f68bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:16.268295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc998-0d7d-484a-af98-75675f2f9e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:16.268644 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc998-0d7d-484a-af98-75675f2f9e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:16.268988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc998-0d7d-484a-af98-75675f2f9e4a admin admin] PATH_INFO: `/v3/projects/4bf8f03ea63046ddb4ff6945407b7ffc/users/4f200ccee578467682bf4f0f20767d89/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:16.287124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bc4b9-e549-4a18-882f-6451a6f68bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:16.288842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bc4b9-e549-4a18-882f-6451a6f68bca service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:16.293300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc998-0d7d-484a-af98-75675f2f9e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf8f03ea63046ddb4ff6945407b7ffc, user_id=4f200ccee578467682bf4f0f20767d89, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:16.296018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc998-0d7d-484a-af98-75675f2f9e4a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:16.299391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1125/2258] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:16.311076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1134/2259] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:16 2022] PUT /identity/v3/projects/4bf8f03ea63046ddb4ff6945407b7ffc/users/4f200ccee578467682bf4f0f20767d89/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:16.314974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bc4b9-e549-4a18-882f-6451a6f68bca service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:16.326708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bc4b9-e549-4a18-882f-6451a6f68bca service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:16.341882 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:16.391291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4cee2-046b-4fd6-a995-26d5c4d7e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:16.391894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4cee2-046b-4fd6-a995-26d5c4d7e00e admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:16.392170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4cee2-046b-4fd6-a995-26d5c4d7e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:16.392439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4cee2-046b-4fd6-a995-26d5c4d7e00e admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:16.393079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4cee2-046b-4fd6-a995-26d5c4d7e00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:16.394696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4cee2-046b-4fd6-a995-26d5c4d7e00e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:16.406548 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1126/2260] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:16.410723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc998-0d7d-484a-af98-75675f2f9e4a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:16.421612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc998-0d7d-484a-af98-75675f2f9e4a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:16.427341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783a395-5080-4383-8a5d-779388eff471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:16.428140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783a395-5080-4383-8a5d-779388eff471 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:16.428493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783a395-5080-4383-8a5d-779388eff471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:16.428811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783a395-5080-4383-8a5d-779388eff471 admin admin] PATH_INFO: `/v3/projects/4bf8f03ea63046ddb4ff6945407b7ffc/users/4f200ccee578467682bf4f0f20767d89/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:16.431030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783a395-5080-4383-8a5d-779388eff471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf8f03ea63046ddb4ff6945407b7ffc, user_id=4f200ccee578467682bf4f0f20767d89, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:16.433782 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783a395-5080-4383-8a5d-779388eff471 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:16.446232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1135/2261] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:16 2022] PUT /identity/v3/projects/4bf8f03ea63046ddb4ff6945407b7ffc/users/4f200ccee578467682bf4f0f20767d89/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:16.590604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4cee2-046b-4fd6-a995-26d5c4d7e00e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:16.592867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b0e4cee2-046b-4fd6-a995-26d5c4d7e00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:16.623931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4cee2-046b-4fd6-a995-26d5c4d7e00e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:16.719346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:16.722865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:16.723853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:16.724214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] PATH_INFO: `/v3/projects/bcb8fe7b87ef4e2ea70f12da1435a369` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:16.726648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb8fe7b87ef4e2ea70f12da1435a369)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:16.728686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:16.833050 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb8fe7b87ef4e2ea70f12da1435a369', 'request_id': 'req-7239b88f-7b86-40a9-9caa-465a495b0e6e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:16.843977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb8fe7b87ef4e2ea70f12da1435a369', 'request_id': 'req-7239b88f-7b86-40a9-9caa-465a495b0e6e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:16.857654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb8fe7b87ef4e2ea70f12da1435a369', 'request_id': 'req-7239b88f-7b86-40a9-9caa-465a495b0e6e'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:16.879184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] The token cache is being invalidate because project bcb8fe7b87ef4e2ea70f12da1435a369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:16.879477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:16.883971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7239b88f-7b86-40a9-9caa-465a495b0e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:16.885019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1127/2262] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:16 2022] DELETE /identity/v3/projects/bcb8fe7b87ef4e2ea70f12da1435a369 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:17.221229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1b8bd-bd49-40a6-9c2d-63b4805d967c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:17.221876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1b8bd-bd49-40a6-9c2d-63b4805d967c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:17.222286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1b8bd-bd49-40a6-9c2d-63b4805d967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:17.268036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-46e1b8bd-bd49-40a6-9c2d-63b4805d967c None None] MFA Rules not processed for user `4f200ccee578467682bf4f0f20767d89`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:17.269350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-46e1b8bd-bd49-40a6-9c2d-63b4805d967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:17.386731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1136/2263] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:17.397669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe100f9-f024-43d9-88ad-341b62bb07f6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:17.398030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe100f9-f024-43d9-88ad-341b62bb07f6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:17.398377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe100f9-f024-43d9-88ad-341b62bb07f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:17.422439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2fe100f9-f024-43d9-88ad-341b62bb07f6 None None] MFA Rules not processed for user `fe7c7d0e22094ffea57636a2afaebae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:17.424003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2fe100f9-f024-43d9-88ad-341b62bb07f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:17.477650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:17.511278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1128/2264] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:36:17.530075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1b8bd-bd49-40a6-9c2d-63b4805d967c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:17.531510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-46e1b8bd-bd49-40a6-9c2d-63b4805d967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:17.553041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:17.611238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1b8bd-bd49-40a6-9c2d-63b4805d967c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:17.616741 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2587b-bb19-47e5-ac84-8c8e3de7f41b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:17.617351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2587b-bb19-47e5-ac84-8c8e3de7f41b service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:17.617632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2587b-bb19-47e5-ac84-8c8e3de7f41b service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:17.617904 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2587b-bb19-47e5-ac84-8c8e3de7f41b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:17.619685 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-05e2587b-bb19-47e5-ac84-8c8e3de7f41b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:17.630064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2587b-bb19-47e5-ac84-8c8e3de7f41b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:17.632225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2587b-bb19-47e5-ac84-8c8e3de7f41b service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:17.641509 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1137/2265] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:27.497277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:27.637521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=26 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:28.471877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe100f9-f024-43d9-88ad-341b62bb07f6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:28.473528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2fe100f9-f024-43d9-88ad-341b62bb07f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:28.549187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe100f9-f024-43d9-88ad-341b62bb07f6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:28.555304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:28.556172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:28.556452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:28.556722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] PATH_INFO: `/v3/users/2163bb976c3b4988851baa521e038785` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:28.557884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2163bb976c3b4988851baa521e038785)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:28.559935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:28.623371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2163bb976c3b4988851baa521e038785'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:28.623371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2163bb976c3b4988851baa521e038785'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:28.636888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2163bb976c3b4988851baa521e038785'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:28.643730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2163bb976c3b4988851baa521e038785'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:28.644462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2163bb976c3b4988851baa521e038785'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:28.659576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1129/2266] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:28 2022] DELETE /identity/v3/users/2163bb976c3b4988851baa521e038785 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:28.664326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74bf9c-9386-44df-9a18-a0e472f6ed90 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:28.664833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74bf9c-9386-44df-9a18-a0e472f6ed90 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:28.664911 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74bf9c-9386-44df-9a18-a0e472f6ed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:28.687171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9e74bf9c-9386-44df-9a18-a0e472f6ed90 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:28.688285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e74bf9c-9386-44df-9a18-a0e472f6ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:28.754909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1138/2267] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:28.767825 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:28.771680 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:28.840506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7085a-01f4-465b-ac88-08b5234b1d6b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:28.844792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55970e2-4014-4b6e-a0d5-a5374342dbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:28.845415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55970e2-4014-4b6e-a0d5-a5374342dbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:28.845700 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55970e2-4014-4b6e-a0d5-a5374342dbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:28.846003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55970e2-4014-4b6e-a0d5-a5374342dbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:28.861940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55970e2-4014-4b6e-a0d5-a5374342dbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:28.863420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55970e2-4014-4b6e-a0d5-a5374342dbf7 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:28.876114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1130/2268] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:29.187687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74bf9c-9386-44df-9a18-a0e472f6ed90 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:29.189821 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e74bf9c-9386-44df-9a18-a0e472f6ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:29.202466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74bf9c-9386-44df-9a18-a0e472f6ed90 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:29.213996 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:29.215011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.215197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.215409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] PATH_INFO: `/v3/projects/ee6b5090dce0427787766ccfa55e060f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.217482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6b5090dce0427787766ccfa55e060f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:29.219582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:29.277383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6b5090dce0427787766ccfa55e060f', 'request_id': 'req-2715c0bc-4f99-472b-8232-db34a572b391'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:29.283431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6b5090dce0427787766ccfa55e060f', 'request_id': 'req-2715c0bc-4f99-472b-8232-db34a572b391'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:29.297186 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6b5090dce0427787766ccfa55e060f', 'request_id': 'req-2715c0bc-4f99-472b-8232-db34a572b391'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:29.315344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] The token cache is being invalidate because project ee6b5090dce0427787766ccfa55e060f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:29.315647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:29.316272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2715c0bc-4f99-472b-8232-db34a572b391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:29.317935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1139/2269] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:29 2022] DELETE /identity/v3/projects/ee6b5090dce0427787766ccfa55e060f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:29.323470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37471-28db-451c-894e-de73f68d59ed None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.324008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37471-28db-451c-894e-de73f68d59ed None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.324490 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37471-28db-451c-894e-de73f68d59ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.346529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-10c37471-28db-451c-894e-de73f68d59ed None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:29.347777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-10c37471-28db-451c-894e-de73f68d59ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:29.365457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:29.415390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1131/2270] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:29.423709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174847f-37cb-474a-8e49-0cfef652f28e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.424006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174847f-37cb-474a-8e49-0cfef652f28e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.424363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174847f-37cb-474a-8e49-0cfef652f28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.445390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6174847f-37cb-474a-8e49-0cfef652f28e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:29.446604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6174847f-37cb-474a-8e49-0cfef652f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:29.454978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1140/2271] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:29.459424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c37471-28db-451c-894e-de73f68d59ed None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:29.469695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c37471-28db-451c-894e-de73f68d59ed None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:29.474717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed6a6c-7a61-41ed-abb1-841663efe404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:29.476282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed6a6c-7a61-41ed-abb1-841663efe404 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.476432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed6a6c-7a61-41ed-abb1-841663efe404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.476793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed6a6c-7a61-41ed-abb1-841663efe404 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.477506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed6a6c-7a61-41ed-abb1-841663efe404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:29.477878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed6a6c-7a61-41ed-abb1-841663efe404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:29.479600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed6a6c-7a61-41ed-abb1-841663efe404 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:29.514398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1132/2272] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:29.518624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174847f-37cb-474a-8e49-0cfef652f28e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:29.531358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174847f-37cb-474a-8e49-0cfef652f28e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:29.541706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664ce24-91ed-4610-91e8-557cb803b784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:29.541706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664ce24-91ed-4610-91e8-557cb803b784 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.541706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664ce24-91ed-4610-91e8-557cb803b784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.541706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664ce24-91ed-4610-91e8-557cb803b784 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.542076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664ce24-91ed-4610-91e8-557cb803b784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:29.543167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664ce24-91ed-4610-91e8-557cb803b784 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:29.578197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1141/2273] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:36:29 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:29.582539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed6a6c-7a61-41ed-abb1-841663efe404 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:29.597946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed6a6c-7a61-41ed-abb1-841663efe404 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:29.669648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a8f3e-4654-4344-9f5f-9a6088134f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:29.670237 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8f3e-4654-4344-9f5f-9a6088134f7d admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.670516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8f3e-4654-4344-9f5f-9a6088134f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.673978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8f3e-4654-4344-9f5f-9a6088134f7d admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.674717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a8f3e-4654-4344-9f5f-9a6088134f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:29.676667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a8f3e-4654-4344-9f5f-9a6088134f7d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:29.699671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1133/2274] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:36:29 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:29.704946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664ce24-91ed-4610-91e8-557cb803b784 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:29.717947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664ce24-91ed-4610-91e8-557cb803b784 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:29.726549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0955-cb47-4d07-a5c8-37847932da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:29.727910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0955-cb47-4d07-a5c8-37847932da35 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.728054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0955-cb47-4d07-a5c8-37847932da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.728415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0955-cb47-4d07-a5c8-37847932da35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.729708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd0955-cb47-4d07-a5c8-37847932da35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:29.732296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd0955-cb47-4d07-a5c8-37847932da35 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:29.747336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1142/2275] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:29.752021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a8f3e-4654-4344-9f5f-9a6088134f7d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:29.763528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a8f3e-4654-4344-9f5f-9a6088134f7d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:29.768347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ebcb7-a9b2-46fc-8fff-10e66e5670f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:29.768938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ebcb7-a9b2-46fc-8fff-10e66e5670f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.769216 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ebcb7-a9b2-46fc-8fff-10e66e5670f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.769501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ebcb7-a9b2-46fc-8fff-10e66e5670f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.770119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ebcb7-a9b2-46fc-8fff-10e66e5670f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:29.771722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ebcb7-a9b2-46fc-8fff-10e66e5670f4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:29.783172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1134/2276] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:36:29.787221 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0955-cb47-4d07-a5c8-37847932da35 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:29.798085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0955-cb47-4d07-a5c8-37847932da35 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:29.802697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec720a3b-a479-4ac0-8346-2adeea89fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:29.803401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec720a3b-a479-4ac0-8346-2adeea89fb19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.803818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec720a3b-a479-4ac0-8346-2adeea89fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.804095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec720a3b-a479-4ac0-8346-2adeea89fb19 admin admin] PATH_INFO: `/v3/projects/a0d1568c088048c180947c2406ad084b/users/d203614f803a47d783ffa1a928bc92de/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.818576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec720a3b-a479-4ac0-8346-2adeea89fb19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d1568c088048c180947c2406ad084b, user_id=d203614f803a47d783ffa1a928bc92de, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:29.821470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec720a3b-a479-4ac0-8346-2adeea89fb19 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:29.835896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1143/2277] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:29 2022] PUT /identity/v3/projects/a0d1568c088048c180947c2406ad084b/users/d203614f803a47d783ffa1a928bc92de/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:29.847433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542aa6-6a6c-4df5-a816-640254a1520c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.847754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542aa6-6a6c-4df5-a816-640254a1520c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.848905 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542aa6-6a6c-4df5-a816-640254a1520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.880576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a5897-6bd5-442b-91b2-ae444fb592e1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:29.880942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a5897-6bd5-442b-91b2-ae444fb592e1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:29.881294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a5897-6bd5-442b-91b2-ae444fb592e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:29.882956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-38542aa6-6a6c-4df5-a816-640254a1520c None None] MFA Rules not processed for user `d203614f803a47d783ffa1a928bc92de`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:29.884217 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-38542aa6-6a6c-4df5-a816-640254a1520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:29.902535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b12a5897-6bd5-442b-91b2-ae444fb592e1 None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:29.903780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b12a5897-6bd5-442b-91b2-ae444fb592e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:29.919267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:29.953815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1135/2278] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:29.966086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38542aa6-6a6c-4df5-a816-640254a1520c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:29.967537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-38542aa6-6a6c-4df5-a816-640254a1520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:29.970450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1144/2279] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:36:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:36:29.991990 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:30.015998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a5897-6bd5-442b-91b2-ae444fb592e1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:30.017423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b12a5897-6bd5-442b-91b2-ae444fb592e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:30.037883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38542aa6-6a6c-4df5-a816-640254a1520c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:30.041842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda99e1-df4a-4560-a393-c2e5e107fb72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:30.042624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda99e1-df4a-4560-a393-c2e5e107fb72 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:30.043075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda99e1-df4a-4560-a393-c2e5e107fb72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:30.043353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda99e1-df4a-4560-a393-c2e5e107fb72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:30.052340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda99e1-df4a-4560-a393-c2e5e107fb72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:30.054009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda99e1-df4a-4560-a393-c2e5e107fb72 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:30.064014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1136/2280] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:36:30.094113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a5897-6bd5-442b-91b2-ae444fb592e1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:30.099763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c99bc6-dda4-47d7-bf9f-04d18d7aa36f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:30.101150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99bc6-dda4-47d7-bf9f-04d18d7aa36f service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:30.101516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99bc6-dda4-47d7-bf9f-04d18d7aa36f service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:30.101791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99bc6-dda4-47d7-bf9f-04d18d7aa36f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:30.110429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c99bc6-dda4-47d7-bf9f-04d18d7aa36f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:30.112066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c99bc6-dda4-47d7-bf9f-04d18d7aa36f service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:30.120543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1145/2281] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:36:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:36:33.717641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda99e1-df4a-4560-a393-c2e5e107fb72 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:33.726909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda99e1-df4a-4560-a393-c2e5e107fb72 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:33.730754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14b8a8-8f3b-4bde-b6f9-686f6f22ea2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:33.731351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14b8a8-8f3b-4bde-b6f9-686f6f22ea2b service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:33.731630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14b8a8-8f3b-4bde-b6f9-686f6f22ea2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:33.731906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14b8a8-8f3b-4bde-b6f9-686f6f22ea2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:33.733630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fe14b8a8-8f3b-4bde-b6f9-686f6f22ea2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:33.803198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14b8a8-8f3b-4bde-b6f9-686f6f22ea2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:33.804735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14b8a8-8f3b-4bde-b6f9-686f6f22ea2b service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:33.814556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1137/2282] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:40.117280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=48 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:41.993571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c99bc6-dda4-47d7-bf9f-04d18d7aa36f service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:42.120346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c99bc6-dda4-47d7-bf9f-04d18d7aa36f service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:42.126478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:42.127152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:42.127434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:42.127704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] PATH_INFO: `/v3/users/d203614f803a47d783ffa1a928bc92de` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:42.128848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d203614f803a47d783ffa1a928bc92de)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:42.130870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:42.216868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd203614f803a47d783ffa1a928bc92de'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:42.217981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd203614f803a47d783ffa1a928bc92de'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:42.234473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd203614f803a47d783ffa1a928bc92de'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:42.238744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd203614f803a47d783ffa1a928bc92de'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:42.257228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd203614f803a47d783ffa1a928bc92de'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:42.288504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1146/2283] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:41 2022] DELETE /identity/v3/users/d203614f803a47d783ffa1a928bc92de => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:42.293365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287997-ed72-4f88-b4c9-db6177fbb024 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:42.293929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287997-ed72-4f88-b4c9-db6177fbb024 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:42.293929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287997-ed72-4f88-b4c9-db6177fbb024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:42.328971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d1287997-ed72-4f88-b4c9-db6177fbb024 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:42.330521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d1287997-ed72-4f88-b4c9-db6177fbb024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:42.411665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1138/2284] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:36:42.422493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:42.425158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:42.522781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617a954-9f4f-4198-9c79-f4c8e20111c2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:42.527875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157a205-a578-4a3c-9593-d359cfe5b66c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:42.528793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157a205-a578-4a3c-9593-d359cfe5b66c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:42.529158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157a205-a578-4a3c-9593-d359cfe5b66c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:42.529562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157a205-a578-4a3c-9593-d359cfe5b66c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:42.545415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157a205-a578-4a3c-9593-d359cfe5b66c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:42.547475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157a205-a578-4a3c-9593-d359cfe5b66c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:42.561498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1147/2285] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:42.909864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1287997-ed72-4f88-b4c9-db6177fbb024 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:42.912208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d1287997-ed72-4f88-b4c9-db6177fbb024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:42.935048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1287997-ed72-4f88-b4c9-db6177fbb024 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:42.948481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:42.949233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:42.949591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:42.949927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] PATH_INFO: `/v3/projects/a0d1568c088048c180947c2406ad084b` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:42.951814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d1568c088048c180947c2406ad084b)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:42.954754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:43.058582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d1568c088048c180947c2406ad084b', 'request_id': 'req-63b96608-9e3e-400d-be18-c43cc4826df2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:43.059917 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:43.068876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d1568c088048c180947c2406ad084b', 'request_id': 'req-63b96608-9e3e-400d-be18-c43cc4826df2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:43.077935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d1568c088048c180947c2406ad084b', 'request_id': 'req-63b96608-9e3e-400d-be18-c43cc4826df2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:43.097183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] The token cache is being invalidate because project a0d1568c088048c180947c2406ad084b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:43.097741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:43.098713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-63b96608-9e3e-400d-be18-c43cc4826df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:43.107916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1139/2286] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:42 2022] DELETE /identity/v3/projects/a0d1568c088048c180947c2406ad084b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:43.109238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803c3a1-3777-4e79-8db8-e5aa0f07c07f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:43.109749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803c3a1-3777-4e79-8db8-e5aa0f07c07f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:43.110436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803c3a1-3777-4e79-8db8-e5aa0f07c07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:43.153907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7803c3a1-3777-4e79-8db8-e5aa0f07c07f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:43.158408 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7803c3a1-3777-4e79-8db8-e5aa0f07c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:43.194704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:43.315218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1148/2287] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:43.327643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c050c-af43-416b-881d-52c8c616236e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:43.328587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c050c-af43-416b-881d-52c8c616236e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:43.329017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c050c-af43-416b-881d-52c8c616236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:43.354441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-142c050c-af43-416b-881d-52c8c616236e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:43.356421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-142c050c-af43-416b-881d-52c8c616236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:43.371505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1140/2288] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:43.377204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803c3a1-3777-4e79-8db8-e5aa0f07c07f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:43.392354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803c3a1-3777-4e79-8db8-e5aa0f07c07f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:43.399513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cce8ea-70c3-48b6-a896-3fc5deb9f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:43.400284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cce8ea-70c3-48b6-a896-3fc5deb9f452 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:43.403320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cce8ea-70c3-48b6-a896-3fc5deb9f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:43.403709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cce8ea-70c3-48b6-a896-3fc5deb9f452 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:43.405938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cce8ea-70c3-48b6-a896-3fc5deb9f452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:43.405938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cce8ea-70c3-48b6-a896-3fc5deb9f452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:43.408270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cce8ea-70c3-48b6-a896-3fc5deb9f452 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:43.430308 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c050c-af43-416b-881d-52c8c616236e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:43.438356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1149/2289] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:43.444603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c050c-af43-416b-881d-52c8c616236e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:43.453760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18011c17-53ca-4df8-a04e-855886087bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:43.458170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011c17-53ca-4df8-a04e-855886087bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:43.460058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011c17-53ca-4df8-a04e-855886087bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:43.460920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011c17-53ca-4df8-a04e-855886087bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:43.462015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18011c17-53ca-4df8-a04e-855886087bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:43.466135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18011c17-53ca-4df8-a04e-855886087bc4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:43.525689 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1141/2290] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:36:43 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:43.530414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cce8ea-70c3-48b6-a896-3fc5deb9f452 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:43.547758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cce8ea-70c3-48b6-a896-3fc5deb9f452 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:43.704118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810201c2-d57d-4f2b-9aff-8299ee416cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:43.705541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810201c2-d57d-4f2b-9aff-8299ee416cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:43.706123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810201c2-d57d-4f2b-9aff-8299ee416cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:43.706588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810201c2-d57d-4f2b-9aff-8299ee416cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:43.707541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810201c2-d57d-4f2b-9aff-8299ee416cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:43.710760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810201c2-d57d-4f2b-9aff-8299ee416cf4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:43.751443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1150/2291] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:36:43 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:43.755713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18011c17-53ca-4df8-a04e-855886087bc4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:43.773481 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18011c17-53ca-4df8-a04e-855886087bc4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:43.784368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cda06-ccc0-4e3c-a16b-3b5c93b1a8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:43.785886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cda06-ccc0-4e3c-a16b-3b5c93b1a8ba admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:43.787929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cda06-ccc0-4e3c-a16b-3b5c93b1a8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:43.788788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cda06-ccc0-4e3c-a16b-3b5c93b1a8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:43.790333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cda06-ccc0-4e3c-a16b-3b5c93b1a8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:43.794834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cda06-ccc0-4e3c-a16b-3b5c93b1a8ba admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:43.817149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1142/2292] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:43.821980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810201c2-d57d-4f2b-9aff-8299ee416cf4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:43.838146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810201c2-d57d-4f2b-9aff-8299ee416cf4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:43.847018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8a45e-607d-4b56-863d-ebb1079f8398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:43.848144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8a45e-607d-4b56-863d-ebb1079f8398 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:43.848498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8a45e-607d-4b56-863d-ebb1079f8398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:43.849166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8a45e-607d-4b56-863d-ebb1079f8398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:43.851297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8a45e-607d-4b56-863d-ebb1079f8398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:43.854194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8a45e-607d-4b56-863d-ebb1079f8398 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:43.873844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1151/2293] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:36:43.877894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cda06-ccc0-4e3c-a16b-3b5c93b1a8ba admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:43.894042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cda06-ccc0-4e3c-a16b-3b5c93b1a8ba admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:43.901011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06dbb7-ca2e-4b07-ae46-5a0e3d84d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:43.904270 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06dbb7-ca2e-4b07-ae46-5a0e3d84d24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:43.904661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06dbb7-ca2e-4b07-ae46-5a0e3d84d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:43.905164 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06dbb7-ca2e-4b07-ae46-5a0e3d84d24a admin admin] PATH_INFO: `/v3/projects/ac905be9f78a477b96f76cd2c91ead57/users/56e86aebbc044a9aa9624d7a78988ce2/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:43.952649 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06dbb7-ca2e-4b07-ae46-5a0e3d84d24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac905be9f78a477b96f76cd2c91ead57, user_id=56e86aebbc044a9aa9624d7a78988ce2, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:43.968916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06dbb7-ca2e-4b07-ae46-5a0e3d84d24a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:43.993982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1143/2294] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:36:43 2022] PUT /identity/v3/projects/ac905be9f78a477b96f76cd2c91ead57/users/56e86aebbc044a9aa9624d7a78988ce2/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:36:44.004695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da7869-6453-459a-bfec-b73615f86f1d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:44.004988 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da7869-6453-459a-bfec-b73615f86f1d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:44.005543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da7869-6453-459a-bfec-b73615f86f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:44.053953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-86da7869-6453-459a-bfec-b73615f86f1d None None] MFA Rules not processed for user `56e86aebbc044a9aa9624d7a78988ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:44.058171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-86da7869-6453-459a-bfec-b73615f86f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:44.186723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1152/2295] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:44.200008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06dbb7-ca2e-4b07-ae46-5a0e3d84d24a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:44.202450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5c06dbb7-ca2e-4b07-ae46-5a0e3d84d24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:44.299214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06dbb7-ca2e-4b07-ae46-5a0e3d84d24a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:44.306039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b2d22-7586-4cf6-a5db-69d8070d0399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:44.306881 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b2d22-7586-4cf6-a5db-69d8070d0399 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:44.307613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b2d22-7586-4cf6-a5db-69d8070d0399 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:44.307833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b2d22-7586-4cf6-a5db-69d8070d0399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:44.318394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b2d22-7586-4cf6-a5db-69d8070d0399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:44.320149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b2d22-7586-4cf6-a5db-69d8070d0399 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:44.331330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1144/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:46.202014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbfb62-a975-41bc-98c7-7406f0a82405 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:46.202590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbfb62-a975-41bc-98c7-7406f0a82405 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:46.202808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbfb62-a975-41bc-98c7-7406f0a82405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:46.231846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b2d22-7586-4cf6-a5db-69d8070d0399 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:46.233809 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1a8b2d22-7586-4cf6-a5db-69d8070d0399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:46.235838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3dbbfb62-a975-41bc-98c7-7406f0a82405 None None] MFA Rules not processed for user `56e86aebbc044a9aa9624d7a78988ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:46.237720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3dbbfb62-a975-41bc-98c7-7406f0a82405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:46.267938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1153/2297] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:46.343187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b2d22-7586-4cf6-a5db-69d8070d0399 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:46.354346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:46.356580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:46.357215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:46.357738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] PATH_INFO: `/v3/users/a73b6258e8ce422cad0e97a2ec139742` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:46.359739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73b6258e8ce422cad0e97a2ec139742)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:46.363321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:46.401744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:46.496025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73b6258e8ce422cad0e97a2ec139742'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:46.497407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73b6258e8ce422cad0e97a2ec139742'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:46.539444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73b6258e8ce422cad0e97a2ec139742'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:46.560348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73b6258e8ce422cad0e97a2ec139742'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:46.561739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73b6258e8ce422cad0e97a2ec139742'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:46.590418 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1145/2298] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:46 2022] DELETE /identity/v3/users/a73b6258e8ce422cad0e97a2ec139742 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:46.595680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab243bf-497f-4456-98e0-1285164e7927 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:46.596361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab243bf-497f-4456-98e0-1285164e7927 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:46.596927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab243bf-497f-4456-98e0-1285164e7927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:46.627912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2ab243bf-497f-4456-98e0-1285164e7927 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:46.629861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2ab243bf-497f-4456-98e0-1285164e7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:46.640648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:46.759900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1154/2299] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:46.784202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:46.786197 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:46.873396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489e0e9-dd75-4019-a487-2ec88496477f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:46.877229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb533c79-f260-44fb-be58-88f602937d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:46.877872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb533c79-f260-44fb-be58-88f602937d7d service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:46.878154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb533c79-f260-44fb-be58-88f602937d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:46.878425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb533c79-f260-44fb-be58-88f602937d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:46.889258 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb533c79-f260-44fb-be58-88f602937d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:46.891312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb533c79-f260-44fb-be58-88f602937d7d service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:46.911938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1146/2300] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:36:47.316961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab243bf-497f-4456-98e0-1285164e7927 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:47.319985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2ab243bf-497f-4456-98e0-1285164e7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:47.355241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab243bf-497f-4456-98e0-1285164e7927 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:47.381889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:47.383759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:47.384473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:47.388443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] PATH_INFO: `/v3/projects/743bb95a282f4fb6a86d65bcbce9f2c7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:47.391479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743bb95a282f4fb6a86d65bcbce9f2c7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:47.393770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:47.478867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743bb95a282f4fb6a86d65bcbce9f2c7', 'request_id': 'req-991e4ef9-bb5f-49a3-8285-0aa120941035'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:47.485487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743bb95a282f4fb6a86d65bcbce9f2c7', 'request_id': 'req-991e4ef9-bb5f-49a3-8285-0aa120941035'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:47.494226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743bb95a282f4fb6a86d65bcbce9f2c7', 'request_id': 'req-991e4ef9-bb5f-49a3-8285-0aa120941035'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:47.527513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] The token cache is being invalidate because project 743bb95a282f4fb6a86d65bcbce9f2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:36:47.527905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:47.528807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-991e4ef9-bb5f-49a3-8285-0aa120941035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:47.531658 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1155/2301] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:47 2022] DELETE /identity/v3/projects/743bb95a282f4fb6a86d65bcbce9f2c7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:49.170464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b72cde-b9ad-4a4a-adc9-7c842aaf13a0 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:49.171091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b72cde-b9ad-4a4a-adc9-7c842aaf13a0 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:49.171234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b72cde-b9ad-4a4a-adc9-7c842aaf13a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:49.263760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d0b72cde-b9ad-4a4a-adc9-7c842aaf13a0 None None] MFA Rules not processed for user `f961b156bc31426abf95e303115be233`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:49.264365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d0b72cde-b9ad-4a4a-adc9-7c842aaf13a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:49.418582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1147/2302] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:36:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:53.977239 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b53a5-0dd8-4995-b493-f7ac71a77fdf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:53.979107 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b53a5-0dd8-4995-b493-f7ac71a77fdf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:53.979722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b53a5-0dd8-4995-b493-f7ac71a77fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:54.007894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6d4b53a5-0dd8-4995-b493-f7ac71a77fdf None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:54.010157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6d4b53a5-0dd8-4995-b493-f7ac71a77fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:54.126103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1156/2303] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:36:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:54.164105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b72cde-b9ad-4a4a-adc9-7c842aaf13a0 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:54.165881 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d0b72cde-b9ad-4a4a-adc9-7c842aaf13a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:54.241098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:54.292596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b72cde-b9ad-4a4a-adc9-7c842aaf13a0 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:54.303581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b4963-5543-4411-abf1-bc8e8e184be2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:54.304395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4963-5543-4411-abf1-bc8e8e184be2 service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:54.304770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4963-5543-4411-abf1-bc8e8e184be2 service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:54.305147 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4963-5543-4411-abf1-bc8e8e184be2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:54.314693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b4963-5543-4411-abf1-bc8e8e184be2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:54.316583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b4963-5543-4411-abf1-bc8e8e184be2 service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:54.337418 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1148/2304] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:36:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:36:55.884098 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77eb81-85d2-4786-a48d-2fe62f36edbf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:55.884659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77eb81-85d2-4786-a48d-2fe62f36edbf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:55.884780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77eb81-85d2-4786-a48d-2fe62f36edbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:55.916846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ad77eb81-85d2-4786-a48d-2fe62f36edbf None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:55.918466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ad77eb81-85d2-4786-a48d-2fe62f36edbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:55.928255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1157/2305] 10.222.0.23 () {58 vars in 967 bytes} [Tue Oct 4 08:36:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:36:55.953058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b4963-5543-4411-abf1-bc8e8e184be2 service swift] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:55.967947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b4963-5543-4411-abf1-bc8e8e184be2 service swift] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:55.976448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985259b-a079-4d51-863f-816d8b9a1d0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:55.977577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985259b-a079-4d51-863f-816d8b9a1d0b service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:55.978422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985259b-a079-4d51-863f-816d8b9a1d0b service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:55.978915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985259b-a079-4d51-863f-816d8b9a1d0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:55.990413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985259b-a079-4d51-863f-816d8b9a1d0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:55.992618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985259b-a079-4d51-863f-816d8b9a1d0b service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:56.004241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1149/2306] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:36:58.637967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77eb81-85d2-4786-a48d-2fe62f36edbf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:58.640000 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ad77eb81-85d2-4786-a48d-2fe62f36edbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:58.735758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:58.782188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77eb81-85d2-4786-a48d-2fe62f36edbf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:58.794358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:58.795202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:58.795572 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:58.796046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] PATH_INFO: `/v3/users/9c6351ae09844bd1aba6b0dff3d6ae27` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:58.798420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6351ae09844bd1aba6b0dff3d6ae27)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:58.801014 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:58.927459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6351ae09844bd1aba6b0dff3d6ae27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:58.929514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6351ae09844bd1aba6b0dff3d6ae27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:58.964528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6351ae09844bd1aba6b0dff3d6ae27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:58.967493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6351ae09844bd1aba6b0dff3d6ae27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:59.013989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6351ae09844bd1aba6b0dff3d6ae27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:36:59.046222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1158/2307] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:58 2022] DELETE /identity/v3/users/9c6351ae09844bd1aba6b0dff3d6ae27 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:59.679976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985259b-a079-4d51-863f-816d8b9a1d0b service swift] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:59.697035 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985259b-a079-4d51-863f-816d8b9a1d0b service swift] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:59.811507 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:59.812464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:59.812936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:59.813406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] PATH_INFO: `/v3/projects/577fbc41bc29482f9f346ab4a31f4a99` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:59.815467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577fbc41bc29482f9f346ab4a31f4a99)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:59.820284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:59.984262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:59.985794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:59.990414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577fbc41bc29482f9f346ab4a31f4a99', 'request_id': 'req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.006296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e5f46-bf68-4278-92ff-03ffb56a8506 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.007384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577fbc41bc29482f9f346ab4a31f4a99', 'request_id': 'req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.015048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577fbc41bc29482f9f346ab4a31f4a99', 'request_id': 'req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.043765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] The token cache is being invalidate because project 577fbc41bc29482f9f346ab4a31f4a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:37:00.044288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.047008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e71a2c5c-f0f2-4a6a-ad86-673c63ce4e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.052167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1150/2308] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:36:59 2022] DELETE /identity/v3/projects/577fbc41bc29482f9f346ab4a31f4a99 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:00.058251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e56dc5-03b4-412b-bbea-d80676caa4d8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.059397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e56dc5-03b4-412b-bbea-d80676caa4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.059397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e56dc5-03b4-412b-bbea-d80676caa4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.090965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f1e56dc5-03b4-412b-bbea-d80676caa4d8 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:00.092787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f1e56dc5-03b4-412b-bbea-d80676caa4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:00.106467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.107263 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.107719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.108147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] PATH_INFO: `/v3/users/fe7c7d0e22094ffea57636a2afaebae6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.110058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7c7d0e22094ffea57636a2afaebae6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.112020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.125219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1151/2309] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:00.140377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cfd0e-fb3b-48cb-a755-bfc4d0910b71 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.142218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cfd0e-fb3b-48cb-a755-bfc4d0910b71 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.144002 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cfd0e-fb3b-48cb-a755-bfc4d0910b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.187159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2b7cfd0e-fb3b-48cb-a755-bfc4d0910b71 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:00.188625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2b7cfd0e-fb3b-48cb-a755-bfc4d0910b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:00.200119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1152/2310] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:37:00.204067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cfd0e-fb3b-48cb-a755-bfc4d0910b71 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.215405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cfd0e-fb3b-48cb-a755-bfc4d0910b71 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.220391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0907b1f-c9a3-4385-8fba-036822535fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.221233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0907b1f-c9a3-4385-8fba-036822535fae admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.221607 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0907b1f-c9a3-4385-8fba-036822535fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.221919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0907b1f-c9a3-4385-8fba-036822535fae admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.222661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0907b1f-c9a3-4385-8fba-036822535fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:00.223645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0907b1f-c9a3-4385-8fba-036822535fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.226454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0907b1f-c9a3-4385-8fba-036822535fae admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.227820 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7c7d0e22094ffea57636a2afaebae6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.229390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7c7d0e22094ffea57636a2afaebae6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.240303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:00.242574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7c7d0e22094ffea57636a2afaebae6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.243537 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7c7d0e22094ffea57636a2afaebae6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.256763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1153/2311] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:00.267724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0907b1f-c9a3-4385-8fba-036822535fae admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.273073 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f0907b1f-c9a3-4385-8fba-036822535fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:00.275493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7c7d0e22094ffea57636a2afaebae6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.298079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1159/2312] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:36:59 2022] DELETE /identity/v3/users/fe7c7d0e22094ffea57636a2afaebae6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:37:00.311740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0907b1f-c9a3-4385-8fba-036822535fae admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.344836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:00.424155 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469ea9-6f28-4fcc-b9ca-fb06f575bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.425109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469ea9-6f28-4fcc-b9ca-fb06f575bc42 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.425896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469ea9-6f28-4fcc-b9ca-fb06f575bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.427086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469ea9-6f28-4fcc-b9ca-fb06f575bc42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.428161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17469ea9-6f28-4fcc-b9ca-fb06f575bc42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.434643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17469ea9-6f28-4fcc-b9ca-fb06f575bc42 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.497737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1154/2313] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:37:00 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:00.502723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.515972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78a81-70a0-4e3b-b146-4691769d1bc8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.573709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469ea9-6f28-4fcc-b9ca-fb06f575bc42 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.576181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-17469ea9-6f28-4fcc-b9ca-fb06f575bc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:00.664678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d921f2-0ba1-432a-a957-201763d491f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.665550 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d921f2-0ba1-432a-a957-201763d491f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.666025 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d921f2-0ba1-432a-a957-201763d491f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.666512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d921f2-0ba1-432a-a957-201763d491f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.667398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d921f2-0ba1-432a-a957-201763d491f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.670412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d921f2-0ba1-432a-a957-201763d491f6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.731576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1160/2314] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:37:00 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:37:00.732847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d921f2-0ba1-432a-a957-201763d491f6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.744374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469ea9-6f28-4fcc-b9ca-fb06f575bc42 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.753007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.755986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.756282 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.756564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] PATH_INFO: `/v3/projects/dee374c6283748d0af5c70afa61b10f9` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.759201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d921f2-0ba1-432a-a957-201763d491f6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.760607 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee374c6283748d0af5c70afa61b10f9)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.763434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.776746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1010c-1bd1-4309-bd40-d875aee93be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.777803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1010c-1bd1-4309-bd40-d875aee93be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.778092 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1010c-1bd1-4309-bd40-d875aee93be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.778419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1010c-1bd1-4309-bd40-d875aee93be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.779121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1010c-1bd1-4309-bd40-d875aee93be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.781570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1010c-1bd1-4309-bd40-d875aee93be8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.794708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1161/2315] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:37:00.797642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1010c-1bd1-4309-bd40-d875aee93be8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.813130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1010c-1bd1-4309-bd40-d875aee93be8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.819076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fadf4-57a5-4948-ae9c-64bea9dfd199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.820046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fadf4-57a5-4948-ae9c-64bea9dfd199 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.820765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fadf4-57a5-4948-ae9c-64bea9dfd199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.821518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fadf4-57a5-4948-ae9c-64bea9dfd199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.822854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fadf4-57a5-4948-ae9c-64bea9dfd199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.824955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fadf4-57a5-4948-ae9c-64bea9dfd199 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.858191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1162/2316] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:37:00.859437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fadf4-57a5-4948-ae9c-64bea9dfd199 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.882920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee374c6283748d0af5c70afa61b10f9', 'request_id': 'req-0be4e576-45c4-401d-b4fb-6203d707706f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.887482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fadf4-57a5-4948-ae9c-64bea9dfd199 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.924432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee374c6283748d0af5c70afa61b10f9', 'request_id': 'req-0be4e576-45c4-401d-b4fb-6203d707706f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.952705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee374c6283748d0af5c70afa61b10f9', 'request_id': 'req-0be4e576-45c4-401d-b4fb-6203d707706f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.984534 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] The token cache is being invalidate because project dee374c6283748d0af5c70afa61b10f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:37:00.984994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.986255 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:00.990223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1155/2317] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:37:00 2022] DELETE /identity/v3/projects/dee374c6283748d0af5c70afa61b10f9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:37:00.996431 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.999154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:01.038224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9962f-a922-4025-953c-e49b7a996fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:01.040009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9962f-a922-4025-953c-e49b7a996fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:01.040009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9962f-a922-4025-953c-e49b7a996fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:01.040258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9962f-a922-4025-953c-e49b7a996fe3 admin admin] PATH_INFO: `/v3/projects/155f0833c1fd4e4a85e9d4a70f784926/users/4e52f1d88eeb404ab872a1fc1782d9cd/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:01.070518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9962f-a922-4025-953c-e49b7a996fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=155f0833c1fd4e4a85e9d4a70f784926, user_id=4e52f1d88eeb404ab872a1fc1782d9cd, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:01.077000 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9962f-a922-4025-953c-e49b7a996fe3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:01.126773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1163/2318] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:37:00 2022] PUT /identity/v3/projects/155f0833c1fd4e4a85e9d4a70f784926/users/4e52f1d88eeb404ab872a1fc1782d9cd/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:01.129860 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d553-ceca-4fcc-80b4-82962e068ba2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:01.130162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d553-ceca-4fcc-80b4-82962e068ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:01.130441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d553-ceca-4fcc-80b4-82962e068ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:01.163546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:01.182406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f9d0d553-ceca-4fcc-80b4-82962e068ba2 None None] MFA Rules not processed for user `4e52f1d88eeb404ab872a1fc1782d9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:01.186739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f9d0d553-ceca-4fcc-80b4-82962e068ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:01.205654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4e576-45c4-401d-b4fb-6203d707706f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:01.221252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:01.294276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:01.295546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:01.296127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:01.296792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] PATH_INFO: `/v3/users/4f200ccee578467682bf4f0f20767d89` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:01.298754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f200ccee578467682bf4f0f20767d89)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:01.303152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:01.440995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1164/2319] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:01.449064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f200ccee578467682bf4f0f20767d89'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:01.450427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0d553-ceca-4fcc-80b4-82962e068ba2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:01.451344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f200ccee578467682bf4f0f20767d89'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:01.475982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f9d0d553-ceca-4fcc-80b4-82962e068ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:01.499801 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f200ccee578467682bf4f0f20767d89'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:01.524867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f200ccee578467682bf4f0f20767d89'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:01.526245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f200ccee578467682bf4f0f20767d89'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:01.556194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1156/2320] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:37:00 2022] DELETE /identity/v3/users/4f200ccee578467682bf4f0f20767d89 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:01.719867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0d553-ceca-4fcc-80b4-82962e068ba2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:01.859747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8caa2-14be-444e-8962-fff2cd513ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:01.860395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8caa2-14be-444e-8962-fff2cd513ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:01.860685 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8caa2-14be-444e-8962-fff2cd513ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:01.860981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8caa2-14be-444e-8962-fff2cd513ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:01.865209 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-57e8caa2-14be-444e-8962-fff2cd513ce3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:01.907696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:01.909851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:02.073181 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8caa2-14be-444e-8962-fff2cd513ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.075843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8caa2-14be-444e-8962-fff2cd513ce3 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.080742 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a93e8-e4ad-48b7-bb75-77d2425573c6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.087212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.088170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.088651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.089142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] PATH_INFO: `/v3/projects/4bf8f03ea63046ddb4ff6945407b7ffc` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.089531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1165/2321] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:02.091055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf8f03ea63046ddb4ff6945407b7ffc)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.098449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.120314 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:02.203511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf8f03ea63046ddb4ff6945407b7ffc', 'request_id': 'req-c7c3e6eb-7918-4b65-aa47-f9e696153173'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:02.217593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf8f03ea63046ddb4ff6945407b7ffc', 'request_id': 'req-c7c3e6eb-7918-4b65-aa47-f9e696153173'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:02.230926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf8f03ea63046ddb4ff6945407b7ffc', 'request_id': 'req-c7c3e6eb-7918-4b65-aa47-f9e696153173'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:02.254816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] The token cache is being invalidate because project 4bf8f03ea63046ddb4ff6945407b7ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:37:02.255213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:02.256248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c7c3e6eb-7918-4b65-aa47-f9e696153173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:02.258553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1157/2322] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:37:01 2022] DELETE /identity/v3/projects/4bf8f03ea63046ddb4ff6945407b7ffc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:37:02.267852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c954fc7-6271-4faa-bb5f-d70e124cc760 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.268292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c954fc7-6271-4faa-bb5f-d70e124cc760 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.268529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c954fc7-6271-4faa-bb5f-d70e124cc760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.298925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7c954fc7-6271-4faa-bb5f-d70e124cc760 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:02.300152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7c954fc7-6271-4faa-bb5f-d70e124cc760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:02.322630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:02.387095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1166/2323] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:02.395975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06369af-331b-41d5-9a40-6c326672ce9b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.396392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06369af-331b-41d5-9a40-6c326672ce9b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.396657 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06369af-331b-41d5-9a40-6c326672ce9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.434279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c06369af-331b-41d5-9a40-6c326672ce9b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:02.435542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c06369af-331b-41d5-9a40-6c326672ce9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:02.479115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1158/2324] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:02.479959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c954fc7-6271-4faa-bb5f-d70e124cc760 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.496922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c954fc7-6271-4faa-bb5f-d70e124cc760 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.503066 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8b143-c824-4d49-ad43-13f12ee1fdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.504491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8b143-c824-4d49-ad43-13f12ee1fdcb admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.505492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8b143-c824-4d49-ad43-13f12ee1fdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.505839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8b143-c824-4d49-ad43-13f12ee1fdcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.506488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8b143-c824-4d49-ad43-13f12ee1fdcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:02.506887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8b143-c824-4d49-ad43-13f12ee1fdcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.508656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8b143-c824-4d49-ad43-13f12ee1fdcb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.532420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1167/2325] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:02.536664 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06369af-331b-41d5-9a40-6c326672ce9b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.562702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06369af-331b-41d5-9a40-6c326672ce9b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.572377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403c3bd-771c-400e-be2f-1c77b9b8eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.573015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403c3bd-771c-400e-be2f-1c77b9b8eb0b admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.573300 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403c3bd-771c-400e-be2f-1c77b9b8eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.573576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403c3bd-771c-400e-be2f-1c77b9b8eb0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.574236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403c3bd-771c-400e-be2f-1c77b9b8eb0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.580139 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403c3bd-771c-400e-be2f-1c77b9b8eb0b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.630419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1159/2326] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:37:02 2022] POST /identity/v3/projects => generated 399 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:02.634211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8b143-c824-4d49-ad43-13f12ee1fdcb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.653851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8b143-c824-4d49-ad43-13f12ee1fdcb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.779102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939ebb5-87e4-4227-ac8d-256edcc8a8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.780018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939ebb5-87e4-4227-ac8d-256edcc8a8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.780759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939ebb5-87e4-4227-ac8d-256edcc8a8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.781098 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939ebb5-87e4-4227-ac8d-256edcc8a8b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.781874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939ebb5-87e4-4227-ac8d-256edcc8a8b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.784126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939ebb5-87e4-4227-ac8d-256edcc8a8b2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.810828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1168/2327] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:37:02 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:02.815720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403c3bd-771c-400e-be2f-1c77b9b8eb0b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.830707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403c3bd-771c-400e-be2f-1c77b9b8eb0b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.836331 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9d3c0-9848-418b-b35a-7af5aff9af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.836996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9d3c0-9848-418b-b35a-7af5aff9af7d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.837366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9d3c0-9848-418b-b35a-7af5aff9af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.837698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9d3c0-9848-418b-b35a-7af5aff9af7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.838455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9d3c0-9848-418b-b35a-7af5aff9af7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.840149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9d3c0-9848-418b-b35a-7af5aff9af7d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.858586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1160/2328] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:37:02.859967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939ebb5-87e4-4227-ac8d-256edcc8a8b2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.873675 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939ebb5-87e4-4227-ac8d-256edcc8a8b2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.876450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225efc4f-09bb-4536-a6f7-4132e2a18c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.877162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225efc4f-09bb-4536-a6f7-4132e2a18c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.877444 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225efc4f-09bb-4536-a6f7-4132e2a18c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.877718 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225efc4f-09bb-4536-a6f7-4132e2a18c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.878424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225efc4f-09bb-4536-a6f7-4132e2a18c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.880238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225efc4f-09bb-4536-a6f7-4132e2a18c55 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.892808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1169/2329] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:37:02.897819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9d3c0-9848-418b-b35a-7af5aff9af7d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.914401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9d3c0-9848-418b-b35a-7af5aff9af7d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.920705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f558d-6cd1-49ba-bdd6-7f1e319b8219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.921695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f558d-6cd1-49ba-bdd6-7f1e319b8219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.921977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f558d-6cd1-49ba-bdd6-7f1e319b8219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.922477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f558d-6cd1-49ba-bdd6-7f1e319b8219 admin admin] PATH_INFO: `/v3/projects/4cb977e217874ee194dcddc3cc0c4d8f/users/391a5ba5c4474acbb6ef37ba0d466ebf/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.942849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f558d-6cd1-49ba-bdd6-7f1e319b8219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb977e217874ee194dcddc3cc0c4d8f, user_id=391a5ba5c4474acbb6ef37ba0d466ebf, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.945717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f558d-6cd1-49ba-bdd6-7f1e319b8219 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.974255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba3164-4699-4379-b9eb-1111878a421b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.974705 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1161/2330] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:37:02 2022] PUT /identity/v3/projects/4cb977e217874ee194dcddc3cc0c4d8f/users/391a5ba5c4474acbb6ef37ba0d466ebf/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:02.975140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba3164-4699-4379-b9eb-1111878a421b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.975616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba3164-4699-4379-b9eb-1111878a421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.037453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-97ba3164-4699-4379-b9eb-1111878a421b None None] MFA Rules not processed for user `391a5ba5c4474acbb6ef37ba0d466ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:03.039138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-97ba3164-4699-4379-b9eb-1111878a421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:03.155249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1170/2331] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:37:03.163724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f558d-6cd1-49ba-bdd6-7f1e319b8219 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:03.165469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9e4f558d-6cd1-49ba-bdd6-7f1e319b8219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:03.276532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f558d-6cd1-49ba-bdd6-7f1e319b8219 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:03.286871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8628f-f316-4153-850c-fefad953fd33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:03.287515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8628f-f316-4153-850c-fefad953fd33 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:03.287797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8628f-f316-4153-850c-fefad953fd33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:03.288142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8628f-f316-4153-850c-fefad953fd33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.305853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8628f-f316-4153-850c-fefad953fd33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:03.309067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8628f-f316-4153-850c-fefad953fd33 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:03.320885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1162/2332] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:05.040834 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba3164-4699-4379-b9eb-1111878a421b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:05.043261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-97ba3164-4699-4379-b9eb-1111878a421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:05.080676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:05.201826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba3164-4699-4379-b9eb-1111878a421b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:05.216941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:05.217663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:05.217952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:05.218225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] PATH_INFO: `/v3/users/4e52f1d88eeb404ab872a1fc1782d9cd` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:05.219862 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e52f1d88eeb404ab872a1fc1782d9cd)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:05.224594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:05.335322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e52f1d88eeb404ab872a1fc1782d9cd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:05.336182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e52f1d88eeb404ab872a1fc1782d9cd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:05.353861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e52f1d88eeb404ab872a1fc1782d9cd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:05.354780 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e52f1d88eeb404ab872a1fc1782d9cd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:05.372053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e52f1d88eeb404ab872a1fc1782d9cd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:05.402998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1171/2333] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:37:05 2022] DELETE /identity/v3/users/4e52f1d88eeb404ab872a1fc1782d9cd => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:05.405807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d1ff6-35d1-4e6f-84aa-e2223734ba57 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:05.406304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d1ff6-35d1-4e6f-84aa-e2223734ba57 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:05.406559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d1ff6-35d1-4e6f-84aa-e2223734ba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:05.459283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-895d1ff6-35d1-4e6f-84aa-e2223734ba57 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:05.461084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-895d1ff6-35d1-4e6f-84aa-e2223734ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:05.531679 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:05.568284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1163/2334] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:05.581057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:05.582703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:05.668729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92a605-33fc-4dcb-a8d9-27f023bd6f27 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:05.675294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2942dc-f387-40bf-b2bd-91eda24f536b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:05.678795 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2942dc-f387-40bf-b2bd-91eda24f536b service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:05.679343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2942dc-f387-40bf-b2bd-91eda24f536b service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:05.679570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2942dc-f387-40bf-b2bd-91eda24f536b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:05.690411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2942dc-f387-40bf-b2bd-91eda24f536b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:05.692511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2942dc-f387-40bf-b2bd-91eda24f536b service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:05.712613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1172/2335] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:06.101277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d1ff6-35d1-4e6f-84aa-e2223734ba57 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:06.103148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-895d1ff6-35d1-4e6f-84aa-e2223734ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:06.120966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d1ff6-35d1-4e6f-84aa-e2223734ba57 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:06.127034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:06.128310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:06.129335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:06.129736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] PATH_INFO: `/v3/projects/155f0833c1fd4e4a85e9d4a70f784926` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:06.131202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=155f0833c1fd4e4a85e9d4a70f784926)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:06.133440 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:06.237071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155f0833c1fd4e4a85e9d4a70f784926', 'request_id': 'req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:06.247501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155f0833c1fd4e4a85e9d4a70f784926', 'request_id': 'req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:06.256920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155f0833c1fd4e4a85e9d4a70f784926', 'request_id': 'req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:06.276120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] The token cache is being invalidate because project 155f0833c1fd4e4a85e9d4a70f784926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:37:06.276418 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:06.277089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9b0b14d4-39c3-4cc6-96fb-1563d55d4a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:06.282143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1164/2336] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:37:06 2022] DELETE /identity/v3/projects/155f0833c1fd4e4a85e9d4a70f784926 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:06.283974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dd2b0-1307-4983-b581-2ad22a5a2a00 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:06.284501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dd2b0-1307-4983-b581-2ad22a5a2a00 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:06.284594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dd2b0-1307-4983-b581-2ad22a5a2a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:06.329186 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-aa3dd2b0-1307-4983-b581-2ad22a5a2a00 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:06.330440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa3dd2b0-1307-4983-b581-2ad22a5a2a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:06.374519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:06.426109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1173/2337] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:37:06.434835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b264a7-e05a-458d-9feb-e68faff4b7d7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:06.435337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b264a7-e05a-458d-9feb-e68faff4b7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:06.435429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b264a7-e05a-458d-9feb-e68faff4b7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:06.458612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b5b264a7-e05a-458d-9feb-e68faff4b7d7 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:06.460116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b5b264a7-e05a-458d-9feb-e68faff4b7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:06.474722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1165/2338] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:06.476051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dd2b0-1307-4983-b581-2ad22a5a2a00 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:06.486653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dd2b0-1307-4983-b581-2ad22a5a2a00 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:06.492695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003b568-2434-4532-ad23-70415e214109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:06.493397 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003b568-2434-4532-ad23-70415e214109 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:06.493681 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003b568-2434-4532-ad23-70415e214109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:06.493953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003b568-2434-4532-ad23-70415e214109 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:06.494662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003b568-2434-4532-ad23-70415e214109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:06.494987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003b568-2434-4532-ad23-70415e214109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:06.496824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003b568-2434-4532-ad23-70415e214109 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:06.523671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1174/2339] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:06.527806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b264a7-e05a-458d-9feb-e68faff4b7d7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:06.547913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b264a7-e05a-458d-9feb-e68faff4b7d7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:06.556063 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa383-294d-4615-acbb-731fdcb09314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:06.556941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa383-294d-4615-acbb-731fdcb09314 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:06.557360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa383-294d-4615-acbb-731fdcb09314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:06.557938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa383-294d-4615-acbb-731fdcb09314 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:06.558988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aa383-294d-4615-acbb-731fdcb09314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:06.561842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aa383-294d-4615-acbb-731fdcb09314 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:06.602797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003b568-2434-4532-ad23-70415e214109 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:06.609982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1166/2340] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:37:06 2022] POST /identity/v3/projects => generated 369 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:06.615634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003b568-2434-4532-ad23-70415e214109 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:06.703901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e67f3-3739-470b-94fe-d4f1ba2bb2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:06.705798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e67f3-3739-470b-94fe-d4f1ba2bb2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:06.706194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e67f3-3739-470b-94fe-d4f1ba2bb2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:06.706660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e67f3-3739-470b-94fe-d4f1ba2bb2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:06.708087 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e67f3-3739-470b-94fe-d4f1ba2bb2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:06.710477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e67f3-3739-470b-94fe-d4f1ba2bb2f3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:06.783254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1175/2341] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:37:06 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:06.786062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa383-294d-4615-acbb-731fdcb09314 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:06.801213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa383-294d-4615-acbb-731fdcb09314 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:06.811832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be0706-cf39-4c40-81ee-96b51f37a4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:06.813036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be0706-cf39-4c40-81ee-96b51f37a4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:06.813673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be0706-cf39-4c40-81ee-96b51f37a4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:06.813997 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be0706-cf39-4c40-81ee-96b51f37a4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:06.814995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be0706-cf39-4c40-81ee-96b51f37a4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:06.818485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be0706-cf39-4c40-81ee-96b51f37a4ab admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:06.838118 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e67f3-3739-470b-94fe-d4f1ba2bb2f3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:06.839438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1167/2342] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:37:06.872783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e67f3-3739-470b-94fe-d4f1ba2bb2f3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:06.884870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a9995-9728-4fbd-8316-d85d4533fee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:06.885598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9995-9728-4fbd-8316-d85d4533fee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:06.885939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9995-9728-4fbd-8316-d85d4533fee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:06.886264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9995-9728-4fbd-8316-d85d4533fee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:06.887150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a9995-9728-4fbd-8316-d85d4533fee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:06.888867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a9995-9728-4fbd-8316-d85d4533fee0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:06.912286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1176/2343] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:37:06.915947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be0706-cf39-4c40-81ee-96b51f37a4ab admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:06.931572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be0706-cf39-4c40-81ee-96b51f37a4ab admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:06.942183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67c16d-c5ca-4869-b848-155884cb3fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:06.942183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67c16d-c5ca-4869-b848-155884cb3fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:06.942183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67c16d-c5ca-4869-b848-155884cb3fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:06.942648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67c16d-c5ca-4869-b848-155884cb3fe5 admin admin] PATH_INFO: `/v3/projects/ad29827255014c7fbc983536fa4179a4/users/72f345593945470e83bf3043fa8f8cda/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:06.964928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67c16d-c5ca-4869-b848-155884cb3fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad29827255014c7fbc983536fa4179a4, user_id=72f345593945470e83bf3043fa8f8cda, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:06.967772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67c16d-c5ca-4869-b848-155884cb3fe5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:06.991077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1168/2344] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:37:06 2022] PUT /identity/v3/projects/ad29827255014c7fbc983536fa4179a4/users/72f345593945470e83bf3043fa8f8cda/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:07.010527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49397-ff35-4c48-a6c1-e68e87e5d2d4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:07.012220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49397-ff35-4c48-a6c1-e68e87e5d2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:07.014410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49397-ff35-4c48-a6c1-e68e87e5d2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:07.075800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-63d49397-ff35-4c48-a6c1-e68e87e5d2d4 None None] MFA Rules not processed for user `72f345593945470e83bf3043fa8f8cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:07.077246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-63d49397-ff35-4c48-a6c1-e68e87e5d2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:07.195406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1177/2345] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:07.209541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67c16d-c5ca-4869-b848-155884cb3fe5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:07.211665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3e67c16d-c5ca-4869-b848-155884cb3fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:07.289879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67c16d-c5ca-4869-b848-155884cb3fe5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:07.293797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0a919-fd7c-4c76-b42a-8ae1416f5c4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b2324f9166d4c2dac76f08b03991769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:07.294422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0a919-fd7c-4c76-b42a-8ae1416f5c4f service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:07.294806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0a919-fd7c-4c76-b42a-8ae1416f5c4f service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:07.295089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0a919-fd7c-4c76-b42a-8ae1416f5c4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:07.314035 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0a919-fd7c-4c76-b42a-8ae1416f5c4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:07.315517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0a919-fd7c-4c76-b42a-8ae1416f5c4f service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:07.331199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1169/2346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:07.340694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.033880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c66c6-8feb-44f9-8741-d0ac5f7bb3f6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.034380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c66c6-8feb-44f9-8741-d0ac5f7bb3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.034575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c66c6-8feb-44f9-8741-d0ac5f7bb3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.084734 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2a6c66c6-8feb-44f9-8741-d0ac5f7bb3f6 None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:08.086293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2a6c66c6-8feb-44f9-8741-d0ac5f7bb3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:08.127437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.164703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1178/2347] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:37:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:08.189012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0a919-fd7c-4c76-b42a-8ae1416f5c4f service glance] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:08.192893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bcf0a919-fd7c-4c76-b42a-8ae1416f5c4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:08.379728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0a919-fd7c-4c76-b42a-8ae1416f5c4f service glance] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:08.392293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf27a0-3b0f-4dd4-81fe-b5873e611d81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:08.392920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf27a0-3b0f-4dd4-81fe-b5873e611d81 service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.393200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf27a0-3b0f-4dd4-81fe-b5873e611d81 service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.393476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf27a0-3b0f-4dd4-81fe-b5873e611d81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.408075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf27a0-3b0f-4dd4-81fe-b5873e611d81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:08.410826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf27a0-3b0f-4dd4-81fe-b5873e611d81 service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:08.423660 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1170/2348] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:37:09.164303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c66c6-8feb-44f9-8741-d0ac5f7bb3f6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:09.166627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2a6c66c6-8feb-44f9-8741-d0ac5f7bb3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:09.280011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c66c6-8feb-44f9-8741-d0ac5f7bb3f6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:09.287751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:09.289470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.289855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.290251 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] PATH_INFO: `/v3/users/391a5ba5c4474acbb6ef37ba0d466ebf` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.291617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=391a5ba5c4474acbb6ef37ba0d466ebf)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:09.294703 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:09.371933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391a5ba5c4474acbb6ef37ba0d466ebf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:09.372811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391a5ba5c4474acbb6ef37ba0d466ebf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:09.383288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391a5ba5c4474acbb6ef37ba0d466ebf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:09.384801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391a5ba5c4474acbb6ef37ba0d466ebf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:09.415692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-171a3798-0881-4eb7-9145-bf7b1a498350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391a5ba5c4474acbb6ef37ba0d466ebf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:09.430927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1179/2349] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:37:09 2022] DELETE /identity/v3/users/391a5ba5c4474acbb6ef37ba0d466ebf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:09.435458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cff8d7-aca0-4eec-a1d8-185a608555c9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.436019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cff8d7-aca0-4eec-a1d8-185a608555c9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.436019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cff8d7-aca0-4eec-a1d8-185a608555c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.448262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e3169-a288-468b-9748-72ed0766d099 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.448859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e3169-a288-468b-9748-72ed0766d099 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.449358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e3169-a288-468b-9748-72ed0766d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.460966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-14cff8d7-aca0-4eec-a1d8-185a608555c9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:09.462883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-14cff8d7-aca0-4eec-a1d8-185a608555c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:09.479443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-317e3169-a288-468b-9748-72ed0766d099 None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:09.480755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-317e3169-a288-468b-9748-72ed0766d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:09.563602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1171/2350] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:09.579285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1180/2351] 10.222.0.23 () {58 vars in 967 bytes} [Tue Oct 4 08:37:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:37:09.594190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cff8d7-aca0-4eec-a1d8-185a608555c9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:09.596510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-14cff8d7-aca0-4eec-a1d8-185a608555c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:09.599828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e3169-a288-468b-9748-72ed0766d099 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:09.601463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-317e3169-a288-468b-9748-72ed0766d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:09.609116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:09.709904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cff8d7-aca0-4eec-a1d8-185a608555c9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:09.716725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329fc74-809a-40b6-8018-b99723a41a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:09.717370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329fc74-809a-40b6-8018-b99723a41a06 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.717648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329fc74-809a-40b6-8018-b99723a41a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.717922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329fc74-809a-40b6-8018-b99723a41a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.734437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e3169-a288-468b-9748-72ed0766d099 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:09.736261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329fc74-809a-40b6-8018-b99723a41a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:09.738395 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329fc74-809a-40b6-8018-b99723a41a06 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:09.740794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48eee9-796d-4cec-9269-8f2647f6d097 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:09.741588 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48eee9-796d-4cec-9269-8f2647f6d097 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.741941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48eee9-796d-4cec-9269-8f2647f6d097 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.742280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48eee9-796d-4cec-9269-8f2647f6d097 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.751525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48eee9-796d-4cec-9269-8f2647f6d097 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:09.751789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1172/2352] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:09.753223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48eee9-796d-4cec-9269-8f2647f6d097 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:09.773436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1181/2353] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:37:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:37:10.104263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4742b79-d0cf-4e60-9d0a-3d3c2ebf4284 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.104590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4742b79-d0cf-4e60-9d0a-3d3c2ebf4284 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.104815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4742b79-d0cf-4e60-9d0a-3d3c2ebf4284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.125443 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a4742b79-d0cf-4e60-9d0a-3d3c2ebf4284 None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:10.126786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a4742b79-d0cf-4e60-9d0a-3d3c2ebf4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:10.140013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1173/2354] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:37:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:10.152787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48eee9-796d-4cec-9269-8f2647f6d097 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:10.172106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48eee9-796d-4cec-9269-8f2647f6d097 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:10.179004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89937b47-2376-432c-b2a0-d2c8374a1d2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:10.179705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937b47-2376-432c-b2a0-d2c8374a1d2e service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.180237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937b47-2376-432c-b2a0-d2c8374a1d2e service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.180602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937b47-2376-432c-b2a0-d2c8374a1d2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.191110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89937b47-2376-432c-b2a0-d2c8374a1d2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:10.192979 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89937b47-2376-432c-b2a0-d2c8374a1d2e service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:10.204772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1182/2355] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:37:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:37:10.475344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4742b79-d0cf-4e60-9d0a-3d3c2ebf4284 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:10.478655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a4742b79-d0cf-4e60-9d0a-3d3c2ebf4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:10.504397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4742b79-d0cf-4e60-9d0a-3d3c2ebf4284 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:10.512326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:10.512969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.513452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.513892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] PATH_INFO: `/v3/projects/4cb977e217874ee194dcddc3cc0c4d8f` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.516683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb977e217874ee194dcddc3cc0c4d8f)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:10.518865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:10.568802 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:10.634875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb977e217874ee194dcddc3cc0c4d8f', 'request_id': 'req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:10.650632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb977e217874ee194dcddc3cc0c4d8f', 'request_id': 'req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:10.658219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb977e217874ee194dcddc3cc0c4d8f', 'request_id': 'req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:10.689858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] The token cache is being invalidate because project 4cb977e217874ee194dcddc3cc0c4d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:37:10.690559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:10.693878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f6e8ce38-f9e4-48ca-b25c-9017e1b40b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:10.704961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1174/2356] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:37:10 2022] DELETE /identity/v3/projects/4cb977e217874ee194dcddc3cc0c4d8f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:10.710816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18845d00-d30a-4d8b-8d45-3c843de69af3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.711962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18845d00-d30a-4d8b-8d45-3c843de69af3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.712743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18845d00-d30a-4d8b-8d45-3c843de69af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.720029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10374f-2593-4351-8e9f-40bf4cfe395f None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.720309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10374f-2593-4351-8e9f-40bf4cfe395f None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.720703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10374f-2593-4351-8e9f-40bf4cfe395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.740859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-18845d00-d30a-4d8b-8d45-3c843de69af3 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:10.742382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-18845d00-d30a-4d8b-8d45-3c843de69af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:10.748727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-fa10374f-2593-4351-8e9f-40bf4cfe395f None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:10.750077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fa10374f-2593-4351-8e9f-40bf4cfe395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:10.833930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1183/2357] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:10.836146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1175/2358] 10.222.0.23 () {58 vars in 967 bytes} [Tue Oct 4 08:37:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:37:10.842825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bdf85-973e-488b-91b6-6e311582fd5a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.843140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bdf85-973e-488b-91b6-6e311582fd5a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.843382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bdf85-973e-488b-91b6-6e311582fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.852053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10374f-2593-4351-8e9f-40bf4cfe395f None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:10.853904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fa10374f-2593-4351-8e9f-40bf4cfe395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:10.867034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-873bdf85-973e-488b-91b6-6e311582fd5a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:10.868277 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-873bdf85-973e-488b-91b6-6e311582fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:10.879421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1184/2359] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:10.889852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bdf85-973e-488b-91b6-6e311582fd5a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:10.903327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bdf85-973e-488b-91b6-6e311582fd5a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:10.916743 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9267-66e2-44f7-885c-676bdf511c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:10.917698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9267-66e2-44f7-885c-676bdf511c3e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.919051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9267-66e2-44f7-885c-676bdf511c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.919515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9267-66e2-44f7-885c-676bdf511c3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.922088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb9267-66e2-44f7-885c-676bdf511c3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:10.922500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb9267-66e2-44f7-885c-676bdf511c3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:10.924524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb9267-66e2-44f7-885c-676bdf511c3e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:10.955023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1185/2360] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:10.957370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9267-66e2-44f7-885c-676bdf511c3e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:10.971525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9267-66e2-44f7-885c-676bdf511c3e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:10.979333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b569f3-02b6-4ac3-a543-e423cc9fdb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:10.980809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b569f3-02b6-4ac3-a543-e423cc9fdb5b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.981291 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b569f3-02b6-4ac3-a543-e423cc9fdb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.981578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b569f3-02b6-4ac3-a543-e423cc9fdb5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.982220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b569f3-02b6-4ac3-a543-e423cc9fdb5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:10.986024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b569f3-02b6-4ac3-a543-e423cc9fdb5b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:11.006661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10374f-2593-4351-8e9f-40bf4cfe395f None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:11.012579 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c26c3-6f07-4c66-90d1-9266edf216d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:11.013271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c26c3-6f07-4c66-90d1-9266edf216d8 service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:11.013616 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c26c3-6f07-4c66-90d1-9266edf216d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:11.013958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c26c3-6f07-4c66-90d1-9266edf216d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:11.028411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c26c3-6f07-4c66-90d1-9266edf216d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:11.030462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c26c3-6f07-4c66-90d1-9266edf216d8 service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:11.047592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1186/2361] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:37:10 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:11.051844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b569f3-02b6-4ac3-a543-e423cc9fdb5b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:11.053721 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1176/2362] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:37:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:37:11.116894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:11.166709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b569f3-02b6-4ac3-a543-e423cc9fdb5b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:11.178041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171fa4e-4b51-4d1f-920f-786d821fdb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:11.178831 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171fa4e-4b51-4d1f-920f-786d821fdb0a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:11.179174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171fa4e-4b51-4d1f-920f-786d821fdb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:11.179592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171fa4e-4b51-4d1f-920f-786d821fdb0a admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:11.180431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171fa4e-4b51-4d1f-920f-786d821fdb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:11.183125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171fa4e-4b51-4d1f-920f-786d821fdb0a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:11.222119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1187/2363] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:37:11 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:11.228008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c26c3-6f07-4c66-90d1-9266edf216d8 service swift] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:11.241666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c26c3-6f07-4c66-90d1-9266edf216d8 service swift] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:11.246394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371271e-3743-45bf-81af-3ebb679a29c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:11.247262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371271e-3743-45bf-81af-3ebb679a29c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:11.247610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371271e-3743-45bf-81af-3ebb679a29c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:11.247947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371271e-3743-45bf-81af-3ebb679a29c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:11.248678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371271e-3743-45bf-81af-3ebb679a29c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:11.250447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371271e-3743-45bf-81af-3ebb679a29c0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:11.263191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1177/2364] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:37:11.267037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171fa4e-4b51-4d1f-920f-786d821fdb0a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:11.279360 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171fa4e-4b51-4d1f-920f-786d821fdb0a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:11.293217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5978c-78ac-4235-889d-c5ef9757fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:11.293802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5978c-78ac-4235-889d-c5ef9757fce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:11.294078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5978c-78ac-4235-889d-c5ef9757fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:11.294348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5978c-78ac-4235-889d-c5ef9757fce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:11.295065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5978c-78ac-4235-889d-c5ef9757fce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:11.296738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5978c-78ac-4235-889d-c5ef9757fce5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:11.308172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1188/2365] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:37:11.312426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371271e-3743-45bf-81af-3ebb679a29c0 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:11.324808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371271e-3743-45bf-81af-3ebb679a29c0 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:11.334542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706538a-c611-49d7-9f7d-13873920b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:11.335492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706538a-c611-49d7-9f7d-13873920b1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:11.336866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706538a-c611-49d7-9f7d-13873920b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:11.336866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706538a-c611-49d7-9f7d-13873920b1d4 admin admin] PATH_INFO: `/v3/projects/06306d17d2a94502bd655dfc69937d34/users/75b4a567370b49d1ba6f96df50638d86/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:11.356941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706538a-c611-49d7-9f7d-13873920b1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06306d17d2a94502bd655dfc69937d34, user_id=75b4a567370b49d1ba6f96df50638d86, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:11.360917 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706538a-c611-49d7-9f7d-13873920b1d4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:11.377104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1178/2366] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:37:11 2022] PUT /identity/v3/projects/06306d17d2a94502bd655dfc69937d34/users/75b4a567370b49d1ba6f96df50638d86/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:11.382826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc394ca-10b7-47df-a950-06675c8ea746 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:11.383115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc394ca-10b7-47df-a950-06675c8ea746 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:11.383390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc394ca-10b7-47df-a950-06675c8ea746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:11.407243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5cc394ca-10b7-47df-a950-06675c8ea746 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:11.408670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5cc394ca-10b7-47df-a950-06675c8ea746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:11.520525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1189/2367] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:37:11.521367 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706538a-c611-49d7-9f7d-13873920b1d4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:11.523218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e706538a-c611-49d7-9f7d-13873920b1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:11.533530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:11.622231 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706538a-c611-49d7-9f7d-13873920b1d4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:11.626711 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841015e-e1b0-4e16-8ed4-299e6009c85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:11.627771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841015e-e1b0-4e16-8ed4-299e6009c85e service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:11.629219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841015e-e1b0-4e16-8ed4-299e6009c85e service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:11.629651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841015e-e1b0-4e16-8ed4-299e6009c85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:11.647010 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841015e-e1b0-4e16-8ed4-299e6009c85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:11.649509 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841015e-e1b0-4e16-8ed4-299e6009c85e service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:11.672510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1179/2368] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:37:13.483198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc394ca-10b7-47df-a950-06675c8ea746 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:13.484759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5cc394ca-10b7-47df-a950-06675c8ea746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:13.498062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc394ca-10b7-47df-a950-06675c8ea746 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:13.505962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:13.506888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:13.507357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:13.507788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] PATH_INFO: `/v3/users/56e86aebbc044a9aa9624d7a78988ce2` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:13.509170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e86aebbc044a9aa9624d7a78988ce2)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:13.511541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:13.588702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e86aebbc044a9aa9624d7a78988ce2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:13.589546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e86aebbc044a9aa9624d7a78988ce2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:13.600927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e86aebbc044a9aa9624d7a78988ce2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:13.601947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e86aebbc044a9aa9624d7a78988ce2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:13.621856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e86aebbc044a9aa9624d7a78988ce2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:13.638243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1190/2369] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:37:13 2022] DELETE /identity/v3/users/56e86aebbc044a9aa9624d7a78988ce2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:13.643199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2e304-e857-402e-94bc-7e0f39286cb6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:13.643695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2e304-e857-402e-94bc-7e0f39286cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:13.643841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2e304-e857-402e-94bc-7e0f39286cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:13.676845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-7ad2e304-e857-402e-94bc-7e0f39286cb6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:13.678092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7ad2e304-e857-402e-94bc-7e0f39286cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:13.759436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1180/2370] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:13.790700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:13.792059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:13.866114 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:13.900833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dd7e9-1ab0-431a-94fb-218feb7a185b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:13.906198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a5727-4d45-4505-a17c-a9a53bde42b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:13.907062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a5727-4d45-4505-a17c-a9a53bde42b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:13.907543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a5727-4d45-4505-a17c-a9a53bde42b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:13.907972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a5727-4d45-4505-a17c-a9a53bde42b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:13.939276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a5727-4d45-4505-a17c-a9a53bde42b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:13.941684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a5727-4d45-4505-a17c-a9a53bde42b0 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:13.967247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1191/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:14.179804 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2e304-e857-402e-94bc-7e0f39286cb6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:14.182056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7ad2e304-e857-402e-94bc-7e0f39286cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:14.210016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2e304-e857-402e-94bc-7e0f39286cb6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:14.214872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:14.215565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:14.215847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:14.216121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] PATH_INFO: `/v3/projects/ac905be9f78a477b96f76cd2c91ead57` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:14.218708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac905be9f78a477b96f76cd2c91ead57)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:14.221356 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:14.301294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac905be9f78a477b96f76cd2c91ead57', 'request_id': 'req-b4872cc4-f904-4f09-a670-6fd0849335bc'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:14.308613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac905be9f78a477b96f76cd2c91ead57', 'request_id': 'req-b4872cc4-f904-4f09-a670-6fd0849335bc'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:14.315050 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac905be9f78a477b96f76cd2c91ead57', 'request_id': 'req-b4872cc4-f904-4f09-a670-6fd0849335bc'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:14.355095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] The token cache is being invalidate because project ac905be9f78a477b96f76cd2c91ead57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:37:14.355410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:14.356115 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b4872cc4-f904-4f09-a670-6fd0849335bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:14.371578 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1181/2372] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:37:14 2022] DELETE /identity/v3/projects/ac905be9f78a477b96f76cd2c91ead57 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:15.056789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a86e0-f090-4fc6-8335-b4c4438fe649 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.057334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a86e0-f090-4fc6-8335-b4c4438fe649 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.057334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a86e0-f090-4fc6-8335-b4c4438fe649 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.058648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1192/2373] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:15.068080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703396a-f358-4cb5-a6a0-159b16374391 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.068687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703396a-f358-4cb5-a6a0-159b16374391 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.068797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703396a-f358-4cb5-a6a0-159b16374391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.116552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1703396a-f358-4cb5-a6a0-159b16374391 None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:15.117895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1703396a-f358-4cb5-a6a0-159b16374391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:15.155457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:15.255841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1182/2374] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:37:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:15.264708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a86e0-f090-4fc6-8335-b4c4438fe649 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:15.266477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c21a86e0-f090-4fc6-8335-b4c4438fe649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:15.385722 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a86e0-f090-4fc6-8335-b4c4438fe649 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:15.391054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1d868-1c0c-4173-b1bc-1112f8d3b4b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b2324f9166d4c2dac76f08b03991769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:15.392005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1d868-1c0c-4173-b1bc-1112f8d3b4b1 service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.393543 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1d868-1c0c-4173-b1bc-1112f8d3b4b1 service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.394486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1d868-1c0c-4173-b1bc-1112f8d3b4b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.407149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1d868-1c0c-4173-b1bc-1112f8d3b4b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:15.408626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1d868-1c0c-4173-b1bc-1112f8d3b4b1 service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:15.421253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1193/2375] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:15.507318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988437e-de9c-47a9-aed1-d6be35d64083 None None] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.507611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988437e-de9c-47a9-aed1-d6be35d64083 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.507946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988437e-de9c-47a9-aed1-d6be35d64083 None None] PATH_INFO: `/` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.509688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1183/2376] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:15.518507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262ebcf-9d98-4fbc-b18f-c6249fdb1503 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.518507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262ebcf-9d98-4fbc-b18f-c6249fdb1503 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.518507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262ebcf-9d98-4fbc-b18f-c6249fdb1503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.541139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3262ebcf-9d98-4fbc-b18f-c6249fdb1503 None None] MFA Rules not processed for user `9a186bffa7854d34b91edfa4eb4b2498`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:15.542933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3262ebcf-9d98-4fbc-b18f-c6249fdb1503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:15.621555 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1194/2377] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:37:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:37:15.635329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988437e-de9c-47a9-aed1-d6be35d64083 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:15.637499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0988437e-de9c-47a9-aed1-d6be35d64083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:15.651974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988437e-de9c-47a9-aed1-d6be35d64083 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:15.656289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eb913-1616-456e-b2ee-57809e319a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:15.656898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb913-1616-456e-b2ee-57809e319a3a service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.657265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb913-1616-456e-b2ee-57809e319a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.657456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb913-1616-456e-b2ee-57809e319a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.673156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649eb913-1616-456e-b2ee-57809e319a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:15.674594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649eb913-1616-456e-b2ee-57809e319a3a service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:15.685531 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1184/2378] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:15.781995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071107-f926-4c46-b161-35837149953e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.782400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071107-f926-4c46-b161-35837149953e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.782566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071107-f926-4c46-b161-35837149953e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.783917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1195/2379] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:15.791627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b188c0-5726-4480-855f-58c47ebdd737 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.792719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b188c0-5726-4480-855f-58c47ebdd737 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.793105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b188c0-5726-4480-855f-58c47ebdd737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.818399 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f8b188c0-5726-4480-855f-58c47ebdd737 None None] MFA Rules not processed for user `2c6603b106fa4db58f3d1b5099606ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:15.819677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f8b188c0-5726-4480-855f-58c47ebdd737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:15.829537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1185/2380] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:37:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:15.840604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071107-f926-4c46-b161-35837149953e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:15.853346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071107-f926-4c46-b161-35837149953e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:15.859173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022ab57-c16f-4169-a786-0a83f7653ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:15.859782 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ab57-c16f-4169-a786-0a83f7653ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.860539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ab57-c16f-4169-a786-0a83f7653ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.860539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ab57-c16f-4169-a786-0a83f7653ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.872142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ab57-c16f-4169-a786-0a83f7653ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:15.873628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ab57-c16f-4169-a786-0a83f7653ff5 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:15.899028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1196/2381] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:17.495318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caa6e7-461b-472f-a7dd-1f34d0e48860 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:17.496206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caa6e7-461b-472f-a7dd-1f34d0e48860 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:17.496482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caa6e7-461b-472f-a7dd-1f34d0e48860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:17.529644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-35caa6e7-461b-472f-a7dd-1f34d0e48860 None None] MFA Rules not processed for user `75b4a567370b49d1ba6f96df50638d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:17.533250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-35caa6e7-461b-472f-a7dd-1f34d0e48860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:17.612585 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1186/2382] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:17.617585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022ab57-c16f-4169-a786-0a83f7653ff5 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:17.619413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3022ab57-c16f-4169-a786-0a83f7653ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:17.692735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022ab57-c16f-4169-a786-0a83f7653ff5 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:17.697287 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2476296-ff74-4569-963b-0d5853af4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:17.697900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2476296-ff74-4569-963b-0d5853af4c20 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:17.698177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2476296-ff74-4569-963b-0d5853af4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:17.698445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2476296-ff74-4569-963b-0d5853af4c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:17.699122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2476296-ff74-4569-963b-0d5853af4c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:17.701051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2476296-ff74-4569-963b-0d5853af4c20 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:17.731736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:17.742032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1197/2383] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:37:17 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:17.747334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caa6e7-461b-472f-a7dd-1f34d0e48860 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:17.767622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caa6e7-461b-472f-a7dd-1f34d0e48860 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:17.848867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e39345-495c-4cb9-891a-54171c765c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:17.849563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e39345-495c-4cb9-891a-54171c765c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:17.849839 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e39345-495c-4cb9-891a-54171c765c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:17.850112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e39345-495c-4cb9-891a-54171c765c53 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:17.850784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e39345-495c-4cb9-891a-54171c765c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:17.852716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e39345-495c-4cb9-891a-54171c765c53 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:17.877783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1187/2384] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:37:17 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:17.881684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2476296-ff74-4569-963b-0d5853af4c20 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:17.893072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2476296-ff74-4569-963b-0d5853af4c20 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:17.899123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80692d68-1dca-4428-80e2-a7ddcbbf80e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:17.899748 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80692d68-1dca-4428-80e2-a7ddcbbf80e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:17.900036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80692d68-1dca-4428-80e2-a7ddcbbf80e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:17.900306 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80692d68-1dca-4428-80e2-a7ddcbbf80e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:17.901306 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80692d68-1dca-4428-80e2-a7ddcbbf80e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:17.902546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80692d68-1dca-4428-80e2-a7ddcbbf80e6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:17.916303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1198/2385] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:37:17.920644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e39345-495c-4cb9-891a-54171c765c53 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:17.932543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e39345-495c-4cb9-891a-54171c765c53 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:17.939041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4c5b-8fff-464b-92c6-3de4ed7882b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:17.939787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4c5b-8fff-464b-92c6-3de4ed7882b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:17.940128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4c5b-8fff-464b-92c6-3de4ed7882b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:17.942440 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4c5b-8fff-464b-92c6-3de4ed7882b9 admin admin] PATH_INFO: `/v3/projects/54d11209fc5342bdbfc9dd50d347484a/users/d9f87c7edfd44283b5a892a5dce3c321/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:17.959883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4c5b-8fff-464b-92c6-3de4ed7882b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d11209fc5342bdbfc9dd50d347484a, user_id=d9f87c7edfd44283b5a892a5dce3c321, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:17.962556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4c5b-8fff-464b-92c6-3de4ed7882b9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:17.972977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:17.982483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1188/2386] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:37:17 2022] PUT /identity/v3/projects/54d11209fc5342bdbfc9dd50d347484a/users/d9f87c7edfd44283b5a892a5dce3c321/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:17.986419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80692d68-1dca-4428-80e2-a7ddcbbf80e6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:17.996532 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80692d68-1dca-4428-80e2-a7ddcbbf80e6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:18.063382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6b310-f130-46ce-b0a8-6f834bbcc388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:18.064003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6b310-f130-46ce-b0a8-6f834bbcc388 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:18.064280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6b310-f130-46ce-b0a8-6f834bbcc388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:18.064551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6b310-f130-46ce-b0a8-6f834bbcc388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:18.065227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6b310-f130-46ce-b0a8-6f834bbcc388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:18.067600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6b310-f130-46ce-b0a8-6f834bbcc388 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:18.077981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1199/2387] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:37:18.082500 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4c5b-8fff-464b-92c6-3de4ed7882b9 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:18.092848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4c5b-8fff-464b-92c6-3de4ed7882b9 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:18.099159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc355a6-47cf-4727-96eb-868e72aba02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:18.099751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc355a6-47cf-4727-96eb-868e72aba02a admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:18.100034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc355a6-47cf-4727-96eb-868e72aba02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:18.100312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc355a6-47cf-4727-96eb-868e72aba02a admin admin] PATH_INFO: `/v3/projects/54d11209fc5342bdbfc9dd50d347484a/users/d9f87c7edfd44283b5a892a5dce3c321/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:18.102262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc355a6-47cf-4727-96eb-868e72aba02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d11209fc5342bdbfc9dd50d347484a, user_id=d9f87c7edfd44283b5a892a5dce3c321, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:18.104942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc355a6-47cf-4727-96eb-868e72aba02a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:18.116604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1189/2388] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:37:18 2022] PUT /identity/v3/projects/54d11209fc5342bdbfc9dd50d347484a/users/d9f87c7edfd44283b5a892a5dce3c321/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:18.839578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa62d0-7205-461c-b27b-9f05486a8e7a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:18.840511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa62d0-7205-461c-b27b-9f05486a8e7a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:18.840792 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa62d0-7205-461c-b27b-9f05486a8e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:18.900235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-00fa62d0-7205-461c-b27b-9f05486a8e7a None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:18.903217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-00fa62d0-7205-461c-b27b-9f05486a8e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:19.032207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1200/2389] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:19.047306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc355a6-47cf-4727-96eb-868e72aba02a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:19.061483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-adc355a6-47cf-4727-96eb-868e72aba02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:19.208214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc355a6-47cf-4727-96eb-868e72aba02a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:19.217637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146e9b7-728e-4eac-ad67-59f5ebfe8ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:19.218605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146e9b7-728e-4eac-ad67-59f5ebfe8ff8 service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:19.219236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146e9b7-728e-4eac-ad67-59f5ebfe8ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:19.219735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146e9b7-728e-4eac-ad67-59f5ebfe8ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:19.230511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146e9b7-728e-4eac-ad67-59f5ebfe8ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:19.232799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146e9b7-728e-4eac-ad67-59f5ebfe8ff8 service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:19.244981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1190/2390] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:37:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:37:24.325636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318ffb-7e47-4ca2-812c-82665faa07bb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:24.326569 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318ffb-7e47-4ca2-812c-82665faa07bb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:24.327064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318ffb-7e47-4ca2-812c-82665faa07bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:24.396545 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-22318ffb-7e47-4ca2-812c-82665faa07bb None None] MFA Rules not processed for user `d9f87c7edfd44283b5a892a5dce3c321`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:24.397791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-22318ffb-7e47-4ca2-812c-82665faa07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:24.545042 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1201/2391] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:24.563065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146e9b7-728e-4eac-ad67-59f5ebfe8ff8 service swift] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:24.565622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1146e9b7-728e-4eac-ad67-59f5ebfe8ff8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:24.711030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146e9b7-728e-4eac-ad67-59f5ebfe8ff8 service swift] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:24.723315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558b82c-2647-4792-ba56-bc80c57022a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b2324f9166d4c2dac76f08b03991769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:24.724081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b82c-2647-4792-ba56-bc80c57022a9 service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:24.724430 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b82c-2647-4792-ba56-bc80c57022a9 service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:24.724757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b82c-2647-4792-ba56-bc80c57022a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:24.901715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558b82c-2647-4792-ba56-bc80c57022a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:24.903715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558b82c-2647-4792-ba56-bc80c57022a9 service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:24.958588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1191/2392] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:25.130754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42195ab-3459-40fb-8e92-a383f75fe856 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:25.130754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42195ab-3459-40fb-8e92-a383f75fe856 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:25.130973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42195ab-3459-40fb-8e92-a383f75fe856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:25.181222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b42195ab-3459-40fb-8e92-a383f75fe856 None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:25.182665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b42195ab-3459-40fb-8e92-a383f75fe856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:25.212662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1202/2393] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:37:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:25.239498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558b82c-2647-4792-ba56-bc80c57022a9 service glance] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:25.266090 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558b82c-2647-4792-ba56-bc80c57022a9 service glance] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:25.276862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe0464-f967-4ec2-95de-38d285916fd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:25.278093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe0464-f967-4ec2-95de-38d285916fd4 service swift] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:25.278701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe0464-f967-4ec2-95de-38d285916fd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:25.279605 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe0464-f967-4ec2-95de-38d285916fd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:25.308154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe0464-f967-4ec2-95de-38d285916fd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:25.311576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe0464-f967-4ec2-95de-38d285916fd4 service swift] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:25.333406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1192/2394] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:37:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:37:32.139152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42195ab-3459-40fb-8e92-a383f75fe856 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:32.141412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b42195ab-3459-40fb-8e92-a383f75fe856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:32.155510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:32.235545 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42195ab-3459-40fb-8e92-a383f75fe856 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:32.248130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:32.249628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:32.250125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:32.250504 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] PATH_INFO: `/v3/users/72f345593945470e83bf3043fa8f8cda` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:32.259107 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f345593945470e83bf3043fa8f8cda)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:32.259107 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:32.328783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f345593945470e83bf3043fa8f8cda'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:32.329603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f345593945470e83bf3043fa8f8cda'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:32.342113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f345593945470e83bf3043fa8f8cda'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:32.342897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f345593945470e83bf3043fa8f8cda'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:32.374746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f345593945470e83bf3043fa8f8cda'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:32.414582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1203/2395] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:37:32 2022] DELETE /identity/v3/users/72f345593945470e83bf3043fa8f8cda => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:32.419544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83397278-76ff-48cc-9a3a-27207d1ad5f5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:32.420846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83397278-76ff-48cc-9a3a-27207d1ad5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:32.421367 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83397278-76ff-48cc-9a3a-27207d1ad5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:32.462175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-83397278-76ff-48cc-9a3a-27207d1ad5f5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:32.472157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-83397278-76ff-48cc-9a3a-27207d1ad5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:32.493342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:32.560198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1193/2396] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:37:32.571879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:32.573376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:32.652273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acb863-b885-438a-80a2-aa039c7e0590 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:32.656209 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bcd30-c256-4b28-95c4-98060e83e609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:32.657064 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bcd30-c256-4b28-95c4-98060e83e609 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:32.657349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bcd30-c256-4b28-95c4-98060e83e609 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:32.657769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bcd30-c256-4b28-95c4-98060e83e609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:32.670515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bcd30-c256-4b28-95c4-98060e83e609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:32.672144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bcd30-c256-4b28-95c4-98060e83e609 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:32.686904 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1204/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:37:33.058655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83397278-76ff-48cc-9a3a-27207d1ad5f5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:33.060618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-83397278-76ff-48cc-9a3a-27207d1ad5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:33.082760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83397278-76ff-48cc-9a3a-27207d1ad5f5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:33.094006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:33.094614 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:33.095200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:33.095200 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] PATH_INFO: `/v3/projects/ad29827255014c7fbc983536fa4179a4` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:33.097205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad29827255014c7fbc983536fa4179a4)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:33.099168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:33.164082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad29827255014c7fbc983536fa4179a4', 'request_id': 'req-3a2867a1-67b6-4413-841f-cb2818154d8b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:33.171089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad29827255014c7fbc983536fa4179a4', 'request_id': 'req-3a2867a1-67b6-4413-841f-cb2818154d8b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:33.178728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad29827255014c7fbc983536fa4179a4', 'request_id': 'req-3a2867a1-67b6-4413-841f-cb2818154d8b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:33.197505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] The token cache is being invalidate because project ad29827255014c7fbc983536fa4179a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:37:33.197941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:33.198869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-3a2867a1-67b6-4413-841f-cb2818154d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:37:33.202763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1194/2398] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:37:33 2022] DELETE /identity/v3/projects/ad29827255014c7fbc983536fa4179a4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:35.962354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917214c-97c8-44bd-814d-e50959c66eb2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:35.962912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917214c-97c8-44bd-814d-e50959c66eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:35.963013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917214c-97c8-44bd-814d-e50959c66eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:35.983779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6917214c-97c8-44bd-814d-e50959c66eb2 None None] MFA Rules not processed for user `75b4a567370b49d1ba6f96df50638d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:35.985003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6917214c-97c8-44bd-814d-e50959c66eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:36.009073 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:36.043821 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1205/2399] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:37.718250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebabc2-0ce9-4022-b774-f5e3c5220f97 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:37.719067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebabc2-0ce9-4022-b774-f5e3c5220f97 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:37.719067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebabc2-0ce9-4022-b774-f5e3c5220f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:37.739677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-c4ebabc2-0ce9-4022-b774-f5e3c5220f97 None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:37.740913 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c4ebabc2-0ce9-4022-b774-f5e3c5220f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:37.810834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1195/2400] 10.222.0.23 () {58 vars in 967 bytes} [Tue Oct 4 08:37:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:37:37.821356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917214c-97c8-44bd-814d-e50959c66eb2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:37.823551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6917214c-97c8-44bd-814d-e50959c66eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:37.915415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917214c-97c8-44bd-814d-e50959c66eb2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:37.922690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dc4bd-3917-4f02-b937-d8e0d8d9b94b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:37.923768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dc4bd-3917-4f02-b937-d8e0d8d9b94b service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:37.924053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dc4bd-3917-4f02-b937-d8e0d8d9b94b service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:37.924321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dc4bd-3917-4f02-b937-d8e0d8d9b94b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:37.941107 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dc4bd-3917-4f02-b937-d8e0d8d9b94b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:37.943439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dc4bd-3917-4f02-b937-d8e0d8d9b94b service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:37.952404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1206/2401] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:37:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:37:38.923686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98a6fd-353c-4fb0-8be1-6586f2c24cbc None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:38.924144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98a6fd-353c-4fb0-8be1-6586f2c24cbc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:38.924354 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98a6fd-353c-4fb0-8be1-6586f2c24cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:38.945288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0f98a6fd-353c-4fb0-8be1-6586f2c24cbc None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:38.946603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0f98a6fd-353c-4fb0-8be1-6586f2c24cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:38.954309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1196/2402] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:37:38.967604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dc4bd-3917-4f02-b937-d8e0d8d9b94b service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:38.980113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dc4bd-3917-4f02-b937-d8e0d8d9b94b service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:38.985496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc2476-44d4-4786-9d54-eba2ec7a79c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:38.986103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc2476-44d4-4786-9d54-eba2ec7a79c1 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:38.986505 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc2476-44d4-4786-9d54-eba2ec7a79c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:38.986974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc2476-44d4-4786-9d54-eba2ec7a79c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:38.996940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc2476-44d4-4786-9d54-eba2ec7a79c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:38.998571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc2476-44d4-4786-9d54-eba2ec7a79c1 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:39.007615 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1207/2403] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:37:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:37:48.939750 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:49.004412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=50 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:51.428985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98a6fd-353c-4fb0-8be1-6586f2c24cbc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:51.430736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0f98a6fd-353c-4fb0-8be1-6586f2c24cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:51.515781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98a6fd-353c-4fb0-8be1-6586f2c24cbc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:51.521301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a91c-6a8d-4921-a1a0-731aa20b789b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4030325cf0481ab634e253cfed9c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:51.522485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a91c-6a8d-4921-a1a0-731aa20b789b service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:51.522816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a91c-6a8d-4921-a1a0-731aa20b789b service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:51.523096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a91c-6a8d-4921-a1a0-731aa20b789b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:51.524884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d9b3a91c-6a8d-4921-a1a0-731aa20b789b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:51.539310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a91c-6a8d-4921-a1a0-731aa20b789b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:51.541136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a91c-6a8d-4921-a1a0-731aa20b789b service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:51.551759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1197/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:37:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:38:01.548480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=32 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:05.498946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc2476-44d4-4786-9d54-eba2ec7a79c1 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:38:05.500383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ebfc2476-44d4-4786-9d54-eba2ec7a79c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:38:05.558360 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc2476-44d4-4786-9d54-eba2ec7a79c1 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:38:05.567825 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adbd9f-6bb7-40b7-9c83-0726cf5634e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:38:05.568451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adbd9f-6bb7-40b7-9c83-0726cf5634e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:38:05.568730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adbd9f-6bb7-40b7-9c83-0726cf5634e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:38:05.569001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adbd9f-6bb7-40b7-9c83-0726cf5634e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:38:05.570799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-08adbd9f-6bb7-40b7-9c83-0726cf5634e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:38:05.644886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adbd9f-6bb7-40b7-9c83-0726cf5634e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:38:05.646341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adbd9f-6bb7-40b7-9c83-0726cf5634e5 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:38:05.656279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1208/2405] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:38:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:38:12.794528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761feba8-e607-4030-993a-a03e4eab456c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:38:12.795135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761feba8-e607-4030-993a-a03e4eab456c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:38:12.795135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761feba8-e607-4030-993a-a03e4eab456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:38:12.815332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-761feba8-e607-4030-993a-a03e4eab456c None None] MFA Rules not processed for user `f961b156bc31426abf95e303115be233`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:38:12.816509 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-761feba8-e607-4030-993a-a03e4eab456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:38:12.868982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1198/2406] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:38:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:38:15.651640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=50 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:22.862420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=25 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:26.622759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9292109-c3c6-452d-8cc0-e83f332b825d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:38:26.623338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9292109-c3c6-452d-8cc0-e83f332b825d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:38:26.623338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9292109-c3c6-452d-8cc0-e83f332b825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:38:26.642268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d9292109-c3c6-452d-8cc0-e83f332b825d None None] MFA Rules not processed for user `0f98295f825e4d0c8fc54cf9cc07bae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:38:26.643472 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d9292109-c3c6-452d-8cc0-e83f332b825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:38:26.698100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1209/2407] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:38:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:38:36.691623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=25 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:54.692882 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5389a-e030-4a28-bc73-c8feb872dee1 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:38:54.693510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5389a-e030-4a28-bc73-c8feb872dee1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:38:54.693655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5389a-e030-4a28-bc73-c8feb872dee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:38:54.713404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-cbe5389a-e030-4a28-bc73-c8feb872dee1 None None] MFA Rules not processed for user `96219eb4a7d649848ee4e700ae7a65f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:38:54.714713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cbe5389a-e030-4a28-bc73-c8feb872dee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:38:54.768417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1199/2408] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:04.761355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=25 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:17.412162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfb61c-087c-45b3-bae6-0a308104092a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:17.412709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfb61c-087c-45b3-bae6-0a308104092a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:17.412709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfb61c-087c-45b3-bae6-0a308104092a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:17.414035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1210/2409] 10.222.0.23 () {54 vars in 921 bytes} [Tue Oct 4 08:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:17.428639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c194c4-c2f5-4602-afdc-2e601805bdc1 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:17.429108 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c194c4-c2f5-4602-afdc-2e601805bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:17.429233 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c194c4-c2f5-4602-afdc-2e601805bdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:17.449792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e0c194c4-c2f5-4602-afdc-2e601805bdc1 None None] MFA Rules not processed for user `6a4030325cf0481ab634e253cfed9c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:17.451055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e0c194c4-c2f5-4602-afdc-2e601805bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:17.460357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1200/2410] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Oct 4 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:17.478349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae0300-a6ae-43e8-9ad4-a9b48d6b8022 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:17.478615 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae0300-a6ae-43e8-9ad4-a9b48d6b8022 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:17.478973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae0300-a6ae-43e8-9ad4-a9b48d6b8022 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:17.480312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1211/2411] 10.222.0.23 () {54 vars in 961 bytes} [Tue Oct 4 08:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:17.486258 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405d842-bb12-4698-8c9d-c0e03c8ce4a9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:17.486543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405d842-bb12-4698-8c9d-c0e03c8ce4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:17.486851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405d842-bb12-4698-8c9d-c0e03c8ce4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:17.496844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae0300-a6ae-43e8-9ad4-a9b48d6b8022 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:17.498573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-94ae0300-a6ae-43e8-9ad4-a9b48d6b8022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:17.517268 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2405d842-bb12-4698-8c9d-c0e03c8ce4a9 None None] MFA Rules not processed for user `6a4030325cf0481ab634e253cfed9c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:17.518604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2405d842-bb12-4698-8c9d-c0e03c8ce4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:17.527799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1201/2412] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Oct 4 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:17.538160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405d842-bb12-4698-8c9d-c0e03c8ce4a9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:17.549606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405d842-bb12-4698-8c9d-c0e03c8ce4a9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:17.554812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8510dea-3f87-4bab-bd3e-8eaac8e1983a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4030325cf0481ab634e253cfed9c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:17.555632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8510dea-3f87-4bab-bd3e-8eaac8e1983a service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:17.555920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8510dea-3f87-4bab-bd3e-8eaac8e1983a service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:17.556196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8510dea-3f87-4bab-bd3e-8eaac8e1983a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:17.565718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8510dea-3f87-4bab-bd3e-8eaac8e1983a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:17.567748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8510dea-3f87-4bab-bd3e-8eaac8e1983a service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:17.574514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae0300-a6ae-43e8-9ad4-a9b48d6b8022 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:17.579494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1202/2413] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:39:17.579626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:17.580232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:17.580535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:17.580811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] PATH_INFO: `/v3/users/f961b156bc31426abf95e303115be233` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:17.581964 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f961b156bc31426abf95e303115be233)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:17.584112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:17.632058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f961b156bc31426abf95e303115be233'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:17.632716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f961b156bc31426abf95e303115be233'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:17.639946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f961b156bc31426abf95e303115be233'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:17.640633 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f961b156bc31426abf95e303115be233'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:17.652872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-42c883fe-4e01-4b23-8a23-aed4a9d2f968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f961b156bc31426abf95e303115be233'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:17.664963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1212/2414] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:17 2022] DELETE /identity/v3/users/f961b156bc31426abf95e303115be233 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:17.839056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8510dea-3f87-4bab-bd3e-8eaac8e1983a service placement] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:17.857845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8510dea-3f87-4bab-bd3e-8eaac8e1983a service placement] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:17.919629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:17.920184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:17.920465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:17.920741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] PATH_INFO: `/v3/projects/ce9d2fdd351e47948a9245f400c55990` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:17.923021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9d2fdd351e47948a9245f400c55990)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:17.924932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:17.972915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9d2fdd351e47948a9245f400c55990', 'request_id': 'req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:17.979042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9d2fdd351e47948a9245f400c55990', 'request_id': 'req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:17.984516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9d2fdd351e47948a9245f400c55990', 'request_id': 'req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:17.996911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] The token cache is being invalidate because project ce9d2fdd351e47948a9245f400c55990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:17.997199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:17.997831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-76b6bcd2-31f9-4ccd-85b2-f69f5d44ae13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:17.999345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1203/2415] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:17 2022] DELETE /identity/v3/projects/ce9d2fdd351e47948a9245f400c55990 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:18.005793 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf1b86-8226-4317-825f-6a0d13f795b9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.006152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf1b86-8226-4317-825f-6a0d13f795b9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.006427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf1b86-8226-4317-825f-6a0d13f795b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.028386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6baf1b86-8226-4317-825f-6a0d13f795b9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:18.029813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6baf1b86-8226-4317-825f-6a0d13f795b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:18.096312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1213/2416] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:18.104403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35626434-629c-446f-8c8b-f84698b4c6ae None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.104690 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35626434-629c-446f-8c8b-f84698b4c6ae None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.104967 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35626434-629c-446f-8c8b-f84698b4c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.124917 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-35626434-629c-446f-8c8b-f84698b4c6ae None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:18.126662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-35626434-629c-446f-8c8b-f84698b4c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:18.134735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1204/2417] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:18.139137 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf1b86-8226-4317-825f-6a0d13f795b9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.150172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf1b86-8226-4317-825f-6a0d13f795b9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.154971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c832d3-38fb-4f1e-accd-5f8f95f7499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.155572 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c832d3-38fb-4f1e-accd-5f8f95f7499b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.155851 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c832d3-38fb-4f1e-accd-5f8f95f7499b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.156122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c832d3-38fb-4f1e-accd-5f8f95f7499b admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.159030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c832d3-38fb-4f1e-accd-5f8f95f7499b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:39:18.159364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c832d3-38fb-4f1e-accd-5f8f95f7499b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.161001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c832d3-38fb-4f1e-accd-5f8f95f7499b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.173080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1214/2418] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:39:18.177463 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35626434-629c-446f-8c8b-f84698b4c6ae None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.186650 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35626434-629c-446f-8c8b-f84698b4c6ae None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.191887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2672a4-10a1-487d-9954-87303638b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.192491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2672a4-10a1-487d-9954-87303638b400 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.192758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2672a4-10a1-487d-9954-87303638b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.193027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2672a4-10a1-487d-9954-87303638b400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.193681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2672a4-10a1-487d-9954-87303638b400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.195640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2672a4-10a1-487d-9954-87303638b400 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.227053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1205/2419] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:18 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:18.228182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c832d3-38fb-4f1e-accd-5f8f95f7499b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.238971 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c832d3-38fb-4f1e-accd-5f8f95f7499b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.242894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:18.302296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63131a3-e685-4950-b589-5a05b4f02033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.302931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63131a3-e685-4950-b589-5a05b4f02033 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.303213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63131a3-e685-4950-b589-5a05b4f02033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.303485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63131a3-e685-4950-b589-5a05b4f02033 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.304125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63131a3-e685-4950-b589-5a05b4f02033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.306082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63131a3-e685-4950-b589-5a05b4f02033 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.330980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1215/2420] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:18 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:39:18.334122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2672a4-10a1-487d-9954-87303638b400 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.345553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2672a4-10a1-487d-9954-87303638b400 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.350185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474063f-0de3-4ef5-9ac8-8f01db364d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.350818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474063f-0de3-4ef5-9ac8-8f01db364d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.351095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474063f-0de3-4ef5-9ac8-8f01db364d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.351365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474063f-0de3-4ef5-9ac8-8f01db364d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.352007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474063f-0de3-4ef5-9ac8-8f01db364d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.353593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474063f-0de3-4ef5-9ac8-8f01db364d04 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.364341 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1206/2421] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:18.368688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63131a3-e685-4950-b589-5a05b4f02033 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.378840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63131a3-e685-4950-b589-5a05b4f02033 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.384256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d38c1-a8ee-4820-83c7-07c6fcacc27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.384862 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d38c1-a8ee-4820-83c7-07c6fcacc27f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.385147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d38c1-a8ee-4820-83c7-07c6fcacc27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.385567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d38c1-a8ee-4820-83c7-07c6fcacc27f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.386320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d38c1-a8ee-4820-83c7-07c6fcacc27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.387841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d38c1-a8ee-4820-83c7-07c6fcacc27f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.400147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1216/2422] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:18.404632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474063f-0de3-4ef5-9ac8-8f01db364d04 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.414710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474063f-0de3-4ef5-9ac8-8f01db364d04 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.419484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9cda-f64e-490e-b1ae-e9f178606e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.420130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9cda-f64e-490e-b1ae-e9f178606e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.420408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9cda-f64e-490e-b1ae-e9f178606e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.420680 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9cda-f64e-490e-b1ae-e9f178606e24 admin admin] PATH_INFO: `/v3/projects/f17cfaa58ab4419cb47d1edefc3d6101/users/fc7c0dc577304c4cbe70ffc7a8e1d626/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.435537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9cda-f64e-490e-b1ae-e9f178606e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17cfaa58ab4419cb47d1edefc3d6101, user_id=fc7c0dc577304c4cbe70ffc7a8e1d626, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.438958 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9cda-f64e-490e-b1ae-e9f178606e24 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.447483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:18.455782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1207/2423] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:18 2022] PUT /identity/v3/projects/f17cfaa58ab4419cb47d1edefc3d6101/users/fc7c0dc577304c4cbe70ffc7a8e1d626/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:18.462724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc7e3-829c-44d6-bff3-0c74c5fc1f5a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.463159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc7e3-829c-44d6-bff3-0c74c5fc1f5a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.463283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc7e3-829c-44d6-bff3-0c74c5fc1f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.490705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b0cdc7e3-829c-44d6-bff3-0c74c5fc1f5a None None] MFA Rules not processed for user `fc7c0dc577304c4cbe70ffc7a8e1d626`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:18.491924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b0cdc7e3-829c-44d6-bff3-0c74c5fc1f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:18.555409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1217/2424] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:18.559910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9cda-f64e-490e-b1ae-e9f178606e24 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.621790 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9cda-f64e-490e-b1ae-e9f178606e24 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.626823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01736020-af81-49c1-b04a-adffac2e0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.627420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736020-af81-49c1-b04a-adffac2e0bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.627702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736020-af81-49c1-b04a-adffac2e0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.627981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736020-af81-49c1-b04a-adffac2e0bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.628607 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01736020-af81-49c1-b04a-adffac2e0bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.630511 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01736020-af81-49c1-b04a-adffac2e0bc8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.657239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1208/2425] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:18 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:18.661256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc7e3-829c-44d6-bff3-0c74c5fc1f5a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.671647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc7e3-829c-44d6-bff3-0c74c5fc1f5a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.726895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b81f-b4fa-4f24-aaa8-308ee42bc74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.727424 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b81f-b4fa-4f24-aaa8-308ee42bc74b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.727697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b81f-b4fa-4f24-aaa8-308ee42bc74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.727961 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b81f-b4fa-4f24-aaa8-308ee42bc74b admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.728579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7b81f-b4fa-4f24-aaa8-308ee42bc74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.730476 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7b81f-b4fa-4f24-aaa8-308ee42bc74b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.752145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1218/2426] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:18 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:18.756344 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01736020-af81-49c1-b04a-adffac2e0bc8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.766442 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01736020-af81-49c1-b04a-adffac2e0bc8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.771077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c5eaa-eaac-4796-a260-83d89db4b1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.771666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c5eaa-eaac-4796-a260-83d89db4b1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.771943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c5eaa-eaac-4796-a260-83d89db4b1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.772213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c5eaa-eaac-4796-a260-83d89db4b1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.772848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c5eaa-eaac-4796-a260-83d89db4b1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.774486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c5eaa-eaac-4796-a260-83d89db4b1f5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.786459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1209/2427] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:18.790522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b81f-b4fa-4f24-aaa8-308ee42bc74b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.796751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:18.801442 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b81f-b4fa-4f24-aaa8-308ee42bc74b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.807462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759527f-8097-4b46-9eb5-5060710d0b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.808105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759527f-8097-4b46-9eb5-5060710d0b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.808380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759527f-8097-4b46-9eb5-5060710d0b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.808649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759527f-8097-4b46-9eb5-5060710d0b97 admin admin] PATH_INFO: `/v3/projects/2a57196451454979a7cdc1049459d837/users/5e0f24fb81ea43608451f7c106a5c164/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.823324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759527f-8097-4b46-9eb5-5060710d0b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a57196451454979a7cdc1049459d837, user_id=5e0f24fb81ea43608451f7c106a5c164, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.826015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759527f-8097-4b46-9eb5-5060710d0b97 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.840449 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1219/2428] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:18 2022] PUT /identity/v3/projects/2a57196451454979a7cdc1049459d837/users/5e0f24fb81ea43608451f7c106a5c164/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:18.845201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c5eaa-eaac-4796-a260-83d89db4b1f5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.854972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c5eaa-eaac-4796-a260-83d89db4b1f5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.909161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2ff1e-7932-4eba-beb4-d614da07c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.909751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ff1e-7932-4eba-beb4-d614da07c89f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.910035 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ff1e-7932-4eba-beb4-d614da07c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.910296 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ff1e-7932-4eba-beb4-d614da07c89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.910983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2ff1e-7932-4eba-beb4-d614da07c89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.912557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2ff1e-7932-4eba-beb4-d614da07c89f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.922007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1210/2429] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:18.926311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759527f-8097-4b46-9eb5-5060710d0b97 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.936344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759527f-8097-4b46-9eb5-5060710d0b97 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.941542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bffe7e-b576-41b2-afe0-20b8c308ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:18.942178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bffe7e-b576-41b2-afe0-20b8c308ef18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.942455 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bffe7e-b576-41b2-afe0-20b8c308ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.942759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bffe7e-b576-41b2-afe0-20b8c308ef18 admin admin] PATH_INFO: `/v3/projects/2a57196451454979a7cdc1049459d837/users/5e0f24fb81ea43608451f7c106a5c164/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.944632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bffe7e-b576-41b2-afe0-20b8c308ef18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a57196451454979a7cdc1049459d837, user_id=5e0f24fb81ea43608451f7c106a5c164, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:18.947290 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bffe7e-b576-41b2-afe0-20b8c308ef18 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:18.957768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1220/2430] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:18 2022] PUT /identity/v3/projects/2a57196451454979a7cdc1049459d837/users/5e0f24fb81ea43608451f7c106a5c164/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:18.969118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a17e-517d-47db-b633-9209ffb08a42 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.969496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a17e-517d-47db-b633-9209ffb08a42 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.969771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a17e-517d-47db-b633-9209ffb08a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.996870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6098a17e-517d-47db-b633-9209ffb08a42 None None] MFA Rules not processed for user `5e0f24fb81ea43608451f7c106a5c164`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:18.998024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6098a17e-517d-47db-b633-9209ffb08a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:19.054713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:19.065769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1211/2431] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:19.077283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bffe7e-b576-41b2-afe0-20b8c308ef18 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:19.079298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d3bffe7e-b576-41b2-afe0-20b8c308ef18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:19.137779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bffe7e-b576-41b2-afe0-20b8c308ef18 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:19.141593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953df279-341d-496e-99be-2998fc710f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:19.142192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df279-341d-496e-99be-2998fc710f3f service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:19.142464 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df279-341d-496e-99be-2998fc710f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:19.142765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df279-341d-496e-99be-2998fc710f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:19.151773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953df279-341d-496e-99be-2998fc710f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:19.153191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953df279-341d-496e-99be-2998fc710f3f service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:19.162519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1221/2432] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:19.192193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098a17e-517d-47db-b633-9209ffb08a42 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:19.267313 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098a17e-517d-47db-b633-9209ffb08a42 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:19.271871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:19.272529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:19.272808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:19.273089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] PATH_INFO: `/v3/users/fc7c0dc577304c4cbe70ffc7a8e1d626` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:19.274907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7c0dc577304c4cbe70ffc7a8e1d626)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:19.277077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:19.326853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7c0dc577304c4cbe70ffc7a8e1d626'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:19.327501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7c0dc577304c4cbe70ffc7a8e1d626'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:19.342028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7c0dc577304c4cbe70ffc7a8e1d626'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:19.349823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7c0dc577304c4cbe70ffc7a8e1d626'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:19.350526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7c0dc577304c4cbe70ffc7a8e1d626'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:19.363372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1212/2433] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:19 2022] DELETE /identity/v3/users/fc7c0dc577304c4cbe70ffc7a8e1d626 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:19.367915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3196f13-3c8f-42b2-b799-9d5385daf8b6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:19.368213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3196f13-3c8f-42b2-b799-9d5385daf8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:19.368482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3196f13-3c8f-42b2-b799-9d5385daf8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:19.388312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f3196f13-3c8f-42b2-b799-9d5385daf8b6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:19.389514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f3196f13-3c8f-42b2-b799-9d5385daf8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:19.450907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1222/2434] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:19.461965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:19.463382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:19.519936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36fdc9-7971-4f35-9d16-2c697b9f57af admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:19.523527 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb38b6-a8ab-4f32-8a46-4ac7a8ce7812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:19.524129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb38b6-a8ab-4f32-8a46-4ac7a8ce7812 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:19.524405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb38b6-a8ab-4f32-8a46-4ac7a8ce7812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:19.524674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb38b6-a8ab-4f32-8a46-4ac7a8ce7812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:19.533789 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb38b6-a8ab-4f32-8a46-4ac7a8ce7812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:19.535252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb38b6-a8ab-4f32-8a46-4ac7a8ce7812 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:19.544528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1213/2435] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:19.812541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3196f13-3c8f-42b2-b799-9d5385daf8b6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:19.814922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f3196f13-3c8f-42b2-b799-9d5385daf8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:19.827126 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3196f13-3c8f-42b2-b799-9d5385daf8b6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:19.832387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:19.833179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:19.833566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:19.833907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] PATH_INFO: `/v3/projects/f17cfaa58ab4419cb47d1edefc3d6101` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:19.835054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17cfaa58ab4419cb47d1edefc3d6101)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:19.836957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:19.883475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17cfaa58ab4419cb47d1edefc3d6101', 'request_id': 'req-784ae088-266b-4441-b974-1ae0fc3f23b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:19.888912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17cfaa58ab4419cb47d1edefc3d6101', 'request_id': 'req-784ae088-266b-4441-b974-1ae0fc3f23b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:19.894963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17cfaa58ab4419cb47d1edefc3d6101', 'request_id': 'req-784ae088-266b-4441-b974-1ae0fc3f23b0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:19.897414 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:19.909241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] The token cache is being invalidate because project f17cfaa58ab4419cb47d1edefc3d6101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:19.909530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:19.910145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:19.911645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1223/2436] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:19 2022] DELETE /identity/v3/projects/f17cfaa58ab4419cb47d1edefc3d6101 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:19.915872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb38b6-a8ab-4f32-8a46-4ac7a8ce7812 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:19.926138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb38b6-a8ab-4f32-8a46-4ac7a8ce7812 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:19.938865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:19.982081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:19.982853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:19.983135 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:19.983413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] PATH_INFO: `/v3/users/5e0f24fb81ea43608451f7c106a5c164` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:19.984515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0f24fb81ea43608451f7c106a5c164)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:19.986953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:20.031661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0f24fb81ea43608451f7c106a5c164'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:20.032329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0f24fb81ea43608451f7c106a5c164'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:20.044062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0f24fb81ea43608451f7c106a5c164'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:20.051286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0f24fb81ea43608451f7c106a5c164'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:20.051925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d5db1d3d-2f66-4bd3-8efe-7066f32a8070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0f24fb81ea43608451f7c106a5c164'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:20.065391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1214/2437] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:19 2022] DELETE /identity/v3/users/5e0f24fb81ea43608451f7c106a5c164 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:20.328573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:20.330284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:20.343759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ae088-266b-4441-b974-1ae0fc3f23b0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:20.403297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:20.403927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:20.404206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:20.404477 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] PATH_INFO: `/v3/projects/2a57196451454979a7cdc1049459d837` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:20.405597 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a57196451454979a7cdc1049459d837)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:20.408094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:20.463657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a57196451454979a7cdc1049459d837', 'request_id': 'req-aba709f2-90af-4dd5-a065-68b9d1d253e2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:20.471138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a57196451454979a7cdc1049459d837', 'request_id': 'req-aba709f2-90af-4dd5-a065-68b9d1d253e2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:20.477524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a57196451454979a7cdc1049459d837', 'request_id': 'req-aba709f2-90af-4dd5-a065-68b9d1d253e2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:20.490797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] The token cache is being invalidate because project 2a57196451454979a7cdc1049459d837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:20.491089 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:20.491713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-aba709f2-90af-4dd5-a065-68b9d1d253e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:20.493222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1224/2438] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:20 2022] DELETE /identity/v3/projects/2a57196451454979a7cdc1049459d837 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:20.498532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706039f-0b68-4750-9542-3ebb86a69c39 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:20.499060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706039f-0b68-4750-9542-3ebb86a69c39 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:20.499157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706039f-0b68-4750-9542-3ebb86a69c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:20.519174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5706039f-0b68-4750-9542-3ebb86a69c39 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:20.520397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5706039f-0b68-4750-9542-3ebb86a69c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:20.584485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1215/2439] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:20.592442 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031abe11-1630-439d-ab21-d5171835af3e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:20.592729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031abe11-1630-439d-ab21-d5171835af3e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:20.593007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031abe11-1630-439d-ab21-d5171835af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:20.615224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-031abe11-1630-439d-ab21-d5171835af3e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:20.616440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-031abe11-1630-439d-ab21-d5171835af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:20.625048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1225/2440] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:20.629532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706039f-0b68-4750-9542-3ebb86a69c39 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:20.639504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706039f-0b68-4750-9542-3ebb86a69c39 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:20.644688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ad92-61ae-4ec9-b4b1-6ca640bde68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:20.645281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ad92-61ae-4ec9-b4b1-6ca640bde68f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:20.645584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ad92-61ae-4ec9-b4b1-6ca640bde68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:20.645856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ad92-61ae-4ec9-b4b1-6ca640bde68f admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:20.646499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ad92-61ae-4ec9-b4b1-6ca640bde68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:39:20.646841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ad92-61ae-4ec9-b4b1-6ca640bde68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:20.648445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ad92-61ae-4ec9-b4b1-6ca640bde68f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:20.660535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1216/2441] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:39:20.664919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031abe11-1630-439d-ab21-d5171835af3e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:20.674774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031abe11-1630-439d-ab21-d5171835af3e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:20.679383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3846da-ea3b-45bd-8a01-f7f54c916283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:20.679972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3846da-ea3b-45bd-8a01-f7f54c916283 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:20.680252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3846da-ea3b-45bd-8a01-f7f54c916283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:20.680522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3846da-ea3b-45bd-8a01-f7f54c916283 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:20.681164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3846da-ea3b-45bd-8a01-f7f54c916283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:20.683096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3846da-ea3b-45bd-8a01-f7f54c916283 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:20.709586 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1226/2442] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:20 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:20.713870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ad92-61ae-4ec9-b4b1-6ca640bde68f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:20.724429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ad92-61ae-4ec9-b4b1-6ca640bde68f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:20.744276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:20.782806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c92ffd-815c-4d57-82a3-b82631ba29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:20.783423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c92ffd-815c-4d57-82a3-b82631ba29a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:20.783706 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c92ffd-815c-4d57-82a3-b82631ba29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:20.783979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c92ffd-815c-4d57-82a3-b82631ba29a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:20.784606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c92ffd-815c-4d57-82a3-b82631ba29a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:20.786552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c92ffd-815c-4d57-82a3-b82631ba29a7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:20.806714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1217/2443] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:20 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:39:20.810623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3846da-ea3b-45bd-8a01-f7f54c916283 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:20.821963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3846da-ea3b-45bd-8a01-f7f54c916283 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:20.826613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595d93-1f49-4e29-a38e-f091390050a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:20.827238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595d93-1f49-4e29-a38e-f091390050a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:20.827521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595d93-1f49-4e29-a38e-f091390050a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:20.827795 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595d93-1f49-4e29-a38e-f091390050a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:20.829154 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79595d93-1f49-4e29-a38e-f091390050a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:20.830917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79595d93-1f49-4e29-a38e-f091390050a4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:20.841187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1227/2444] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:20.845688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c92ffd-815c-4d57-82a3-b82631ba29a7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:20.855635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c92ffd-815c-4d57-82a3-b82631ba29a7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:20.860942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c1c5c-8d2c-43e5-bf30-0d0609a80675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:20.861535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1c5c-8d2c-43e5-bf30-0d0609a80675 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:20.861815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1c5c-8d2c-43e5-bf30-0d0609a80675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:20.862091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1c5c-8d2c-43e5-bf30-0d0609a80675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:20.862767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c1c5c-8d2c-43e5-bf30-0d0609a80675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:20.864360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c1c5c-8d2c-43e5-bf30-0d0609a80675 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:20.877202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1218/2445] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:20.881437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595d93-1f49-4e29-a38e-f091390050a4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:20.892506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595d93-1f49-4e29-a38e-f091390050a4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:20.897130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85638f-b5f7-4339-b2e9-882e5ac04373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:20.897771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85638f-b5f7-4339-b2e9-882e5ac04373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:20.898055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85638f-b5f7-4339-b2e9-882e5ac04373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:20.898331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85638f-b5f7-4339-b2e9-882e5ac04373 admin admin] PATH_INFO: `/v3/projects/8569701d7f2b41b6b8728f14c9ef0a03/users/88ecbe864c374a31b4d7cf6586aedab8/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:20.913257 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85638f-b5f7-4339-b2e9-882e5ac04373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8569701d7f2b41b6b8728f14c9ef0a03, user_id=88ecbe864c374a31b4d7cf6586aedab8, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:20.915956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85638f-b5f7-4339-b2e9-882e5ac04373 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:20.928936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1228/2446] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:20 2022] PUT /identity/v3/projects/8569701d7f2b41b6b8728f14c9ef0a03/users/88ecbe864c374a31b4d7cf6586aedab8/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:20.939736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2424-7092-48b8-a293-8af22db53469 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:20.940050 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2424-7092-48b8-a293-8af22db53469 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:20.940327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2424-7092-48b8-a293-8af22db53469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:20.967812 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-eded2424-7092-48b8-a293-8af22db53469 None None] MFA Rules not processed for user `88ecbe864c374a31b4d7cf6586aedab8`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:20.969703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-eded2424-7092-48b8-a293-8af22db53469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:21.033222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1219/2447] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:21.037726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85638f-b5f7-4339-b2e9-882e5ac04373 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.058360 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:21.099533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85638f-b5f7-4339-b2e9-882e5ac04373 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.104103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1666c8-ca05-4c19-a9f7-4b74d4a378d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.104699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1666c8-ca05-4c19-a9f7-4b74d4a378d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.104982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1666c8-ca05-4c19-a9f7-4b74d4a378d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.105255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1666c8-ca05-4c19-a9f7-4b74d4a378d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.105881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1666c8-ca05-4c19-a9f7-4b74d4a378d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.107867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1666c8-ca05-4c19-a9f7-4b74d4a378d0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.134736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1229/2448] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:21 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:21.138944 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2424-7092-48b8-a293-8af22db53469 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.149677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2424-7092-48b8-a293-8af22db53469 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.205985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b61e31-d438-4e9c-ba40-e198bae1daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.206593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b61e31-d438-4e9c-ba40-e198bae1daed admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.206901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b61e31-d438-4e9c-ba40-e198bae1daed admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.207175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b61e31-d438-4e9c-ba40-e198bae1daed admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.207816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b61e31-d438-4e9c-ba40-e198bae1daed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.209735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b61e31-d438-4e9c-ba40-e198bae1daed admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.230720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1220/2449] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:21 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:21.234705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1666c8-ca05-4c19-a9f7-4b74d4a378d0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.245310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1666c8-ca05-4c19-a9f7-4b74d4a378d0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.249906 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e850-38d5-4938-b64d-54e163a4a031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.250738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e850-38d5-4938-b64d-54e163a4a031 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.251025 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e850-38d5-4938-b64d-54e163a4a031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.251299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e850-38d5-4938-b64d-54e163a4a031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.251937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e850-38d5-4938-b64d-54e163a4a031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.253536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e850-38d5-4938-b64d-54e163a4a031 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.264198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1230/2450] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:21.268905 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b61e31-d438-4e9c-ba40-e198bae1daed admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.279319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b61e31-d438-4e9c-ba40-e198bae1daed admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.284537 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478cc6a-d833-4cba-8843-c6a171f701e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.285156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478cc6a-d833-4cba-8843-c6a171f701e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.285430 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478cc6a-d833-4cba-8843-c6a171f701e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.285700 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478cc6a-d833-4cba-8843-c6a171f701e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.286342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478cc6a-d833-4cba-8843-c6a171f701e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.287963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478cc6a-d833-4cba-8843-c6a171f701e2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.298031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1221/2451] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:21.302184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e850-38d5-4938-b64d-54e163a4a031 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.312013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e850-38d5-4938-b64d-54e163a4a031 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.316657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082d161-b6a5-4382-a745-cc5bfd7c74ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.317316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d161-b6a5-4382-a745-cc5bfd7c74ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.317595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d161-b6a5-4382-a745-cc5bfd7c74ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.317869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d161-b6a5-4382-a745-cc5bfd7c74ba admin admin] PATH_INFO: `/v3/projects/5bf9dfe9aba44f1ea81d0ebef2e62238/users/5bb83a3527044440893428c9a7279647/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.332702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082d161-b6a5-4382-a745-cc5bfd7c74ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf9dfe9aba44f1ea81d0ebef2e62238, user_id=5bb83a3527044440893428c9a7279647, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.335405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082d161-b6a5-4382-a745-cc5bfd7c74ba admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.349037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1231/2452] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:21 2022] PUT /identity/v3/projects/5bf9dfe9aba44f1ea81d0ebef2e62238/users/5bb83a3527044440893428c9a7279647/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:21.360622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92346a-9eb7-45d2-961f-22119c36f3a3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.360869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92346a-9eb7-45d2-961f-22119c36f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.361142 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92346a-9eb7-45d2-961f-22119c36f3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.381425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:21.393253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-df92346a-9eb7-45d2-961f-22119c36f3a3 None None] MFA Rules not processed for user `5bb83a3527044440893428c9a7279647`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:21.394543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-df92346a-9eb7-45d2-961f-22119c36f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:21.456955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1222/2453] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:21.461502 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082d161-b6a5-4382-a745-cc5bfd7c74ba admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.522756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082d161-b6a5-4382-a745-cc5bfd7c74ba admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.527632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a4b1b-db54-40c6-a3e1-89bfd5b10224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.528231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a4b1b-db54-40c6-a3e1-89bfd5b10224 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.528511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a4b1b-db54-40c6-a3e1-89bfd5b10224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.528784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a4b1b-db54-40c6-a3e1-89bfd5b10224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.529407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a4b1b-db54-40c6-a3e1-89bfd5b10224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.531406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a4b1b-db54-40c6-a3e1-89bfd5b10224 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.559208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1232/2454] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:21 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:21.564517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92346a-9eb7-45d2-961f-22119c36f3a3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.575173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92346a-9eb7-45d2-961f-22119c36f3a3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.631674 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56365698-a40b-4496-8b57-a31586bcc0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.632208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56365698-a40b-4496-8b57-a31586bcc0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.632483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56365698-a40b-4496-8b57-a31586bcc0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.632759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56365698-a40b-4496-8b57-a31586bcc0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.633393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56365698-a40b-4496-8b57-a31586bcc0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.635456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56365698-a40b-4496-8b57-a31586bcc0f8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.661023 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1223/2455] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:21 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:21.662644 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a4b1b-db54-40c6-a3e1-89bfd5b10224 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.672901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a4b1b-db54-40c6-a3e1-89bfd5b10224 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.677458 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca58df-c84a-4af2-ae5b-69def53d8ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.678053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca58df-c84a-4af2-ae5b-69def53d8ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.678337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca58df-c84a-4af2-ae5b-69def53d8ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.678607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca58df-c84a-4af2-ae5b-69def53d8ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.679354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca58df-c84a-4af2-ae5b-69def53d8ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.680962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca58df-c84a-4af2-ae5b-69def53d8ad9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.692442 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1233/2456] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:21.696680 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56365698-a40b-4496-8b57-a31586bcc0f8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.707924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56365698-a40b-4496-8b57-a31586bcc0f8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.712923 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2db2-d9c7-4336-98ae-4d5fc2bd19bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.713604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2db2-d9c7-4336-98ae-4d5fc2bd19bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.713878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2db2-d9c7-4336-98ae-4d5fc2bd19bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.714292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2db2-d9c7-4336-98ae-4d5fc2bd19bb admin admin] PATH_INFO: `/v3/projects/951a7149f24b43a6afa0ce322600dbfd/users/0c6346811fc941f3b8c4988cb45247b9/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.729980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b2db2-d9c7-4336-98ae-4d5fc2bd19bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=951a7149f24b43a6afa0ce322600dbfd, user_id=0c6346811fc941f3b8c4988cb45247b9, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.732653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b2db2-d9c7-4336-98ae-4d5fc2bd19bb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.746128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1224/2457] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:21 2022] PUT /identity/v3/projects/951a7149f24b43a6afa0ce322600dbfd/users/0c6346811fc941f3b8c4988cb45247b9/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:21.750874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca58df-c84a-4af2-ae5b-69def53d8ad9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.761558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca58df-c84a-4af2-ae5b-69def53d8ad9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.806483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:21.827055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8f074-bd16-43c7-b27f-f85607b14e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.827737 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8f074-bd16-43c7-b27f-f85607b14e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.828017 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8f074-bd16-43c7-b27f-f85607b14e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.828888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8f074-bd16-43c7-b27f-f85607b14e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.829827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8f074-bd16-43c7-b27f-f85607b14e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.831457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8f074-bd16-43c7-b27f-f85607b14e11 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.841308 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1234/2458] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:21.851422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2db2-d9c7-4336-98ae-4d5fc2bd19bb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:21.862045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2db2-d9c7-4336-98ae-4d5fc2bd19bb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:21.866699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516904d-3629-4c33-aa91-92f99ab7bca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:21.867365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516904d-3629-4c33-aa91-92f99ab7bca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.867646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516904d-3629-4c33-aa91-92f99ab7bca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.867921 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516904d-3629-4c33-aa91-92f99ab7bca5 admin admin] PATH_INFO: `/v3/projects/951a7149f24b43a6afa0ce322600dbfd/users/0c6346811fc941f3b8c4988cb45247b9/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.869854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516904d-3629-4c33-aa91-92f99ab7bca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951a7149f24b43a6afa0ce322600dbfd, user_id=0c6346811fc941f3b8c4988cb45247b9, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:21.872677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516904d-3629-4c33-aa91-92f99ab7bca5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:21.883745 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1225/2459] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:21 2022] PUT /identity/v3/projects/951a7149f24b43a6afa0ce322600dbfd/users/0c6346811fc941f3b8c4988cb45247b9/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:21.894557 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dad87-d5cb-442f-bcdb-4b61f9d06837 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.894876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dad87-d5cb-442f-bcdb-4b61f9d06837 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.895151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dad87-d5cb-442f-bcdb-4b61f9d06837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.922453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-097dad87-d5cb-442f-bcdb-4b61f9d06837 None None] MFA Rules not processed for user `0c6346811fc941f3b8c4988cb45247b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:21.923684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-097dad87-d5cb-442f-bcdb-4b61f9d06837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:21.989884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1235/2460] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:22.001588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516904d-3629-4c33-aa91-92f99ab7bca5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:22.003427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5516904d-3629-4c33-aa91-92f99ab7bca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:22.059493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516904d-3629-4c33-aa91-92f99ab7bca5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:22.064011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972b9c-9350-4939-b778-7e8cc85b563c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:22.064617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972b9c-9350-4939-b778-7e8cc85b563c service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:22.064894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972b9c-9350-4939-b778-7e8cc85b563c service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:22.065161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972b9c-9350-4939-b778-7e8cc85b563c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:22.072043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:22.074443 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10972b9c-9350-4939-b778-7e8cc85b563c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:22.076183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10972b9c-9350-4939-b778-7e8cc85b563c service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:22.087008 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1226/2461] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:22.585534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dad87-d5cb-442f-bcdb-4b61f9d06837 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:22.586949 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-097dad87-d5cb-442f-bcdb-4b61f9d06837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:22.599076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dad87-d5cb-442f-bcdb-4b61f9d06837 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:22.602524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e26a0e-0f0c-4edc-a9c9-0ddbcbf0dd15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:22.603143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26a0e-0f0c-4edc-a9c9-0ddbcbf0dd15 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:22.603421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26a0e-0f0c-4edc-a9c9-0ddbcbf0dd15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:22.603693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26a0e-0f0c-4edc-a9c9-0ddbcbf0dd15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:22.659836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e26a0e-0f0c-4edc-a9c9-0ddbcbf0dd15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:22.661293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e26a0e-0f0c-4edc-a9c9-0ddbcbf0dd15 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:22.670111 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1236/2462] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:26.729397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972b9c-9350-4939-b778-7e8cc85b563c service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:26.738585 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972b9c-9350-4939-b778-7e8cc85b563c service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:26.742207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bbf69-deda-4911-a1fa-8442d344ace8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:26.742814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bbf69-deda-4911-a1fa-8442d344ace8 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:26.743095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bbf69-deda-4911-a1fa-8442d344ace8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:26.743363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bbf69-deda-4911-a1fa-8442d344ace8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:26.799184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bbf69-deda-4911-a1fa-8442d344ace8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:26.800535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bbf69-deda-4911-a1fa-8442d344ace8 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:26.809258 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1227/2463] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:28.885701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e26a0e-0f0c-4edc-a9c9-0ddbcbf0dd15 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:28.956158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e26a0e-0f0c-4edc-a9c9-0ddbcbf0dd15 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:28.960643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:28.961262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:28.961536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:28.961802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] PATH_INFO: `/v3/users/88ecbe864c374a31b4d7cf6586aedab8` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:28.962921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ecbe864c374a31b4d7cf6586aedab8)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:28.964834 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:28.969306 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:29.011846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ecbe864c374a31b4d7cf6586aedab8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.012549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ecbe864c374a31b4d7cf6586aedab8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.020082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ecbe864c374a31b4d7cf6586aedab8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.020753 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ecbe864c374a31b4d7cf6586aedab8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.033364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ecbe864c374a31b4d7cf6586aedab8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.046664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1237/2464] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:28 2022] DELETE /identity/v3/users/88ecbe864c374a31b4d7cf6586aedab8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:29.051591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2f08-2c43-4292-914a-434a583e0f35 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:29.052418 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2f08-2c43-4292-914a-434a583e0f35 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:29.052800 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2f08-2c43-4292-914a-434a583e0f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:29.071781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-454a2f08-2c43-4292-914a-434a583e0f35 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:29.072959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-454a2f08-2c43-4292-914a-434a583e0f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:29.130727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1228/2465] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:29.140407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:29.142353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:29.198771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c56eaf-3dd8-49f2-83b6-f1381d93afcf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:29.202396 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858602-e232-4c6d-a080-17f235a171f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:29.203034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858602-e232-4c6d-a080-17f235a171f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:29.203312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858602-e232-4c6d-a080-17f235a171f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:29.203577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858602-e232-4c6d-a080-17f235a171f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:29.213813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858602-e232-4c6d-a080-17f235a171f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:29.215279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858602-e232-4c6d-a080-17f235a171f7 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:29.224756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1238/2466] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:29.487862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a2f08-2c43-4292-914a-434a583e0f35 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:29.489325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-454a2f08-2c43-4292-914a-434a583e0f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:29.501885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a2f08-2c43-4292-914a-434a583e0f35 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:29.506465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:29.507131 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:29.507408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:29.507680 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] PATH_INFO: `/v3/projects/8569701d7f2b41b6b8728f14c9ef0a03` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:29.508792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8569701d7f2b41b6b8728f14c9ef0a03)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:29.510736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:29.557389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8569701d7f2b41b6b8728f14c9ef0a03', 'request_id': 'req-207e1246-adc5-43aa-bf58-e2be27a13015'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.564901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8569701d7f2b41b6b8728f14c9ef0a03', 'request_id': 'req-207e1246-adc5-43aa-bf58-e2be27a13015'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.570393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8569701d7f2b41b6b8728f14c9ef0a03', 'request_id': 'req-207e1246-adc5-43aa-bf58-e2be27a13015'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.582663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] The token cache is being invalidate because project 8569701d7f2b41b6b8728f14c9ef0a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:29.582981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.583621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.585122 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1229/2467] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:29 2022] DELETE /identity/v3/projects/8569701d7f2b41b6b8728f14c9ef0a03 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:29.589202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858602-e232-4c6d-a080-17f235a171f7 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:29.599204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858602-e232-4c6d-a080-17f235a171f7 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:29.654070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:29.654723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:29.655006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:29.655281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] PATH_INFO: `/v3/users/5bb83a3527044440893428c9a7279647` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:29.656382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb83a3527044440893428c9a7279647)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:29.658412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:29.686329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:29.706403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb83a3527044440893428c9a7279647'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.707142 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb83a3527044440893428c9a7279647'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.713994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb83a3527044440893428c9a7279647'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.714665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb83a3527044440893428c9a7279647'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.726386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb83a3527044440893428c9a7279647'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:29.739097 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1239/2468] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:29 2022] DELETE /identity/v3/users/5bb83a3527044440893428c9a7279647 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:30.026250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:30.027701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:30.042854 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e1246-adc5-43aa-bf58-e2be27a13015 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:30.058152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:30.120805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:30.121756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:30.122034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:30.122426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] PATH_INFO: `/v3/projects/5bf9dfe9aba44f1ea81d0ebef2e62238` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:30.123651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf9dfe9aba44f1ea81d0ebef2e62238)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:30.126197 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:30.188708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf9dfe9aba44f1ea81d0ebef2e62238', 'request_id': 'req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.195349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf9dfe9aba44f1ea81d0ebef2e62238', 'request_id': 'req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.201020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf9dfe9aba44f1ea81d0ebef2e62238', 'request_id': 'req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.214201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] The token cache is being invalidate because project 5bf9dfe9aba44f1ea81d0ebef2e62238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:30.214484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.215119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.216911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1230/2469] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:30 2022] DELETE /identity/v3/projects/5bf9dfe9aba44f1ea81d0ebef2e62238 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:30.221925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:30.223461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:30.237331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ff724-444f-4a99-95ad-eb7e28bf0461 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:30.295721 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:30.296353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:30.296903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:30.297185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] PATH_INFO: `/v3/users/0c6346811fc941f3b8c4988cb45247b9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:30.298451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6346811fc941f3b8c4988cb45247b9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:30.300391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:30.348094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6346811fc941f3b8c4988cb45247b9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.348680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6346811fc941f3b8c4988cb45247b9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.355876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6346811fc941f3b8c4988cb45247b9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.356499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6346811fc941f3b8c4988cb45247b9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.368479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbd1588d-60ea-46f0-9a7c-4fa7aeee2d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6346811fc941f3b8c4988cb45247b9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.381166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1240/2470] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:30 2022] DELETE /identity/v3/users/0c6346811fc941f3b8c4988cb45247b9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:30.661946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:30.663406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:30.683293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd4bb7-b984-4d99-b058-84b5ebb4e772 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:30.745447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:30.746084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:30.746360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:30.746620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] PATH_INFO: `/v3/projects/951a7149f24b43a6afa0ce322600dbfd` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:30.747792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951a7149f24b43a6afa0ce322600dbfd)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:30.749675 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:30.796712 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951a7149f24b43a6afa0ce322600dbfd', 'request_id': 'req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.797873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:30.804326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951a7149f24b43a6afa0ce322600dbfd', 'request_id': 'req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.810933 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951a7149f24b43a6afa0ce322600dbfd', 'request_id': 'req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.823775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] The token cache is being invalidate because project 951a7149f24b43a6afa0ce322600dbfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:30.824084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.824697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f104bc84-5e4f-43bd-b01b-0d1789eff3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:30.826349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1231/2471] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:30 2022] DELETE /identity/v3/projects/951a7149f24b43a6afa0ce322600dbfd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:30.832903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb48ef-1308-47bf-a7f3-e37740c204aa None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:30.833289 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb48ef-1308-47bf-a7f3-e37740c204aa None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:30.833663 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb48ef-1308-47bf-a7f3-e37740c204aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:30.853644 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-23cb48ef-1308-47bf-a7f3-e37740c204aa None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:30.854877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-23cb48ef-1308-47bf-a7f3-e37740c204aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:30.874307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:30.918775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1241/2472] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:30.929265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ad3b9-0e14-41e0-992b-5f0443ac0e53 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:30.929549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ad3b9-0e14-41e0-992b-5f0443ac0e53 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:30.929820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ad3b9-0e14-41e0-992b-5f0443ac0e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:30.950390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e76ad3b9-0e14-41e0-992b-5f0443ac0e53 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:30.951626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e76ad3b9-0e14-41e0-992b-5f0443ac0e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:30.963192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1232/2473] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:30.964165 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb48ef-1308-47bf-a7f3-e37740c204aa None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:30.973908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb48ef-1308-47bf-a7f3-e37740c204aa None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:30.978652 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fc36-1919-4946-bb33-069209bb44b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:30.979281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fc36-1919-4946-bb33-069209bb44b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:30.979571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fc36-1919-4946-bb33-069209bb44b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:30.979957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fc36-1919-4946-bb33-069209bb44b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:30.980583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567fc36-1919-4946-bb33-069209bb44b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:39:30.980908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567fc36-1919-4946-bb33-069209bb44b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:30.982499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567fc36-1919-4946-bb33-069209bb44b9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:30.994411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1242/2474] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:39:30.999057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ad3b9-0e14-41e0-992b-5f0443ac0e53 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.008884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ad3b9-0e14-41e0-992b-5f0443ac0e53 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.013508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f810627-fb13-407d-941d-0a533a728c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.014185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f810627-fb13-407d-941d-0a533a728c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.014462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f810627-fb13-407d-941d-0a533a728c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.014783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f810627-fb13-407d-941d-0a533a728c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.015420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f810627-fb13-407d-941d-0a533a728c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.017383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f810627-fb13-407d-941d-0a533a728c53 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.049892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1233/2475] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:30 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:39:31.051711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fc36-1919-4946-bb33-069209bb44b9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.062953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fc36-1919-4946-bb33-069209bb44b9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.106239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc0c7-4a33-455e-83ce-0964880a0d6b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.106744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc0c7-4a33-455e-83ce-0964880a0d6b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.106862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc0c7-4a33-455e-83ce-0964880a0d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.127879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cea1c-d943-4590-9c0d-c549efc2c4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.128350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-11afc0c7-4a33-455e-83ce-0964880a0d6b None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:31.128479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cea1c-d943-4590-9c0d-c549efc2c4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.128675 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cea1c-d943-4590-9c0d-c549efc2c4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.128943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cea1c-d943-4590-9c0d-c549efc2c4a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.129570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-11afc0c7-4a33-455e-83ce-0964880a0d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:31.129684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cea1c-d943-4590-9c0d-c549efc2c4a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.131507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cea1c-d943-4590-9c0d-c549efc2c4a2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.155600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1243/2476] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:31 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:31.159452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cea1c-d943-4590-9c0d-c549efc2c4a2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.169361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cea1c-d943-4590-9c0d-c549efc2c4a2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.175640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a456a6-9f07-4689-9156-795f08833686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.176324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a456a6-9f07-4689-9156-795f08833686 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.176524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a456a6-9f07-4689-9156-795f08833686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.176785 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a456a6-9f07-4689-9156-795f08833686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.177889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a456a6-9f07-4689-9156-795f08833686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.179043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a456a6-9f07-4689-9156-795f08833686 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.194363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1244/2477] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:39:31.195399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a456a6-9f07-4689-9156-795f08833686 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.198961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1234/2478] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:39:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:31.206119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a456a6-9f07-4689-9156-795f08833686 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.213917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af92be7-8762-45ab-a015-0c36999c2ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.214612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af92be7-8762-45ab-a015-0c36999c2ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.214824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af92be7-8762-45ab-a015-0c36999c2ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.215082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af92be7-8762-45ab-a015-0c36999c2ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.215788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af92be7-8762-45ab-a015-0c36999c2ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.217341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af92be7-8762-45ab-a015-0c36999c2ed1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.234636 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1245/2479] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:39:31.239504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc0c7-4a33-455e-83ce-0964880a0d6b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.241312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af92be7-8762-45ab-a015-0c36999c2ed1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.243275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9af92be7-8762-45ab-a015-0c36999c2ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:31.252676 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc0c7-4a33-455e-83ce-0964880a0d6b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.258504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625f4bf-5340-41e7-9fc3-e090376173a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.259486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625f4bf-5340-41e7-9fc3-e090376173a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.259740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625f4bf-5340-41e7-9fc3-e090376173a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.260020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625f4bf-5340-41e7-9fc3-e090376173a0 admin admin] PATH_INFO: `/v3/projects/b8425771b6ab43e3bac2df0546723b7f/users/87b1c050ce0b45d7a454009dd42e0b03/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.279052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625f4bf-5340-41e7-9fc3-e090376173a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8425771b6ab43e3bac2df0546723b7f, user_id=87b1c050ce0b45d7a454009dd42e0b03, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.282503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625f4bf-5340-41e7-9fc3-e090376173a0 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.298726 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1235/2480] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:31 2022] PUT /identity/v3/projects/b8425771b6ab43e3bac2df0546723b7f/users/87b1c050ce0b45d7a454009dd42e0b03/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:31.309820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e243-17e8-45a4-b2e9-7b56cbaa2abb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.310100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e243-17e8-45a4-b2e9-7b56cbaa2abb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.310373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e243-17e8-45a4-b2e9-7b56cbaa2abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.337606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af92be7-8762-45ab-a015-0c36999c2ed1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.340111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-acb2e243-17e8-45a4-b2e9-7b56cbaa2abb None None] MFA Rules not processed for user `87b1c050ce0b45d7a454009dd42e0b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:31.341525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-acb2e243-17e8-45a4-b2e9-7b56cbaa2abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:31.361957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:31.411047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd01eb-0605-4d60-b966-5a196bd37c9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.411562 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd01eb-0605-4d60-b966-5a196bd37c9c service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.411843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd01eb-0605-4d60-b966-5a196bd37c9c service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.412012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1236/2481] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:31.412129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd01eb-0605-4d60-b966-5a196bd37c9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.416329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2e243-17e8-45a4-b2e9-7b56cbaa2abb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.436842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:31.476526 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd01eb-0605-4d60-b966-5a196bd37c9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.478148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd01eb-0605-4d60-b966-5a196bd37c9c service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.483773 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2e243-17e8-45a4-b2e9-7b56cbaa2abb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.486511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1246/2482] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:39:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:39:31.488699 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41003b-b436-4a36-a9f3-785d0b38c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.489371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41003b-b436-4a36-a9f3-785d0b38c41d admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.489668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41003b-b436-4a36-a9f3-785d0b38c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.489977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41003b-b436-4a36-a9f3-785d0b38c41d admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.490394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41003b-b436-4a36-a9f3-785d0b38c41d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.492311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41003b-b436-4a36-a9f3-785d0b38c41d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.526933 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1237/2483] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:31 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:39:31.529660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd01eb-0605-4d60-b966-5a196bd37c9c service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.543171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd01eb-0605-4d60-b966-5a196bd37c9c service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.611844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e34b0d-ba04-48f9-8e64-5c884d78bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.612608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e34b0d-ba04-48f9-8e64-5c884d78bcbd admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.612956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e34b0d-ba04-48f9-8e64-5c884d78bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.613294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e34b0d-ba04-48f9-8e64-5c884d78bcbd admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.613982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e34b0d-ba04-48f9-8e64-5c884d78bcbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.616123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e34b0d-ba04-48f9-8e64-5c884d78bcbd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.640185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1247/2484] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:31 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:31.658890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41003b-b436-4a36-a9f3-785d0b38c41d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.674430 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41003b-b436-4a36-a9f3-785d0b38c41d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.682770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ff8f8-f8cb-4fd8-b261-ab8f575a6b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.683408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ff8f8-f8cb-4fd8-b261-ab8f575a6b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.683844 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ff8f8-f8cb-4fd8-b261-ab8f575a6b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.684124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ff8f8-f8cb-4fd8-b261-ab8f575a6b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.684776 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ff8f8-f8cb-4fd8-b261-ab8f575a6b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.686385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ff8f8-f8cb-4fd8-b261-ab8f575a6b27 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.702127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1238/2485] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:31.703967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e34b0d-ba04-48f9-8e64-5c884d78bcbd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.714716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e34b0d-ba04-48f9-8e64-5c884d78bcbd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.719508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b48e23-ac2b-44a1-b95b-5a90cc622222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.720323 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b48e23-ac2b-44a1-b95b-5a90cc622222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.720619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b48e23-ac2b-44a1-b95b-5a90cc622222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.720915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b48e23-ac2b-44a1-b95b-5a90cc622222 admin admin] PATH_INFO: `/v3/projects/41041d11b6c84f9fb3479d2c84bba518/users/10818b1230ee4bccad54b8b35c2099ed/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.737683 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b48e23-ac2b-44a1-b95b-5a90cc622222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41041d11b6c84f9fb3479d2c84bba518, user_id=10818b1230ee4bccad54b8b35c2099ed, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.740378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b48e23-ac2b-44a1-b95b-5a90cc622222 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.756521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1248/2486] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:31 2022] PUT /identity/v3/projects/41041d11b6c84f9fb3479d2c84bba518/users/10818b1230ee4bccad54b8b35c2099ed/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:31.760386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ff8f8-f8cb-4fd8-b261-ab8f575a6b27 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.772334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ff8f8-f8cb-4fd8-b261-ab8f575a6b27 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.852783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2aece-b87d-4894-a56b-1cdda1d3984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.853502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2aece-b87d-4894-a56b-1cdda1d3984c admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.854067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2aece-b87d-4894-a56b-1cdda1d3984c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.854067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2aece-b87d-4894-a56b-1cdda1d3984c admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.854790 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2aece-b87d-4894-a56b-1cdda1d3984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.856402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2aece-b87d-4894-a56b-1cdda1d3984c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.870163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1239/2487] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:31.874373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b48e23-ac2b-44a1-b95b-5a90cc622222 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:31.885187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b48e23-ac2b-44a1-b95b-5a90cc622222 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:31.889702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854676d-f5c1-4307-98ea-5b7fc589dc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:31.890430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854676d-f5c1-4307-98ea-5b7fc589dc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.890823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854676d-f5c1-4307-98ea-5b7fc589dc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.891772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854676d-f5c1-4307-98ea-5b7fc589dc09 admin admin] PATH_INFO: `/v3/projects/41041d11b6c84f9fb3479d2c84bba518/users/10818b1230ee4bccad54b8b35c2099ed/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.893824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854676d-f5c1-4307-98ea-5b7fc589dc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41041d11b6c84f9fb3479d2c84bba518, user_id=10818b1230ee4bccad54b8b35c2099ed, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:31.896866 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854676d-f5c1-4307-98ea-5b7fc589dc09 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:31.911958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1249/2488] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:31 2022] PUT /identity/v3/projects/41041d11b6c84f9fb3479d2c84bba518/users/10818b1230ee4bccad54b8b35c2099ed/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:39:31.922421 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5510-bc3d-4a26-810a-e33cfc1218b4 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:31.922873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5510-bc3d-4a26-810a-e33cfc1218b4 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:31.923097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5510-bc3d-4a26-810a-e33cfc1218b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:31.977527 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-68bb5510-bc3d-4a26-810a-e33cfc1218b4 None None] MFA Rules not processed for user `10818b1230ee4bccad54b8b35c2099ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:31.978788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-68bb5510-bc3d-4a26-810a-e33cfc1218b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:32.058044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1240/2489] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:32.069306 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854676d-f5c1-4307-98ea-5b7fc589dc09 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:32.071171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6854676d-f5c1-4307-98ea-5b7fc589dc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:32.096944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:32.147629 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854676d-f5c1-4307-98ea-5b7fc589dc09 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:32.151570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec531-10b6-4306-9fcc-8b0dc819ba77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:32.152179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec531-10b6-4306-9fcc-8b0dc819ba77 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:32.152456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec531-10b6-4306-9fcc-8b0dc819ba77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:32.152726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec531-10b6-4306-9fcc-8b0dc819ba77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:32.163135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ec531-10b6-4306-9fcc-8b0dc819ba77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:32.164742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ec531-10b6-4306-9fcc-8b0dc819ba77 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:32.174975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1250/2490] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:32.305526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb5510-bc3d-4a26-810a-e33cfc1218b4 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:32.324843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb5510-bc3d-4a26-810a-e33cfc1218b4 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:32.334776 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e59de-8cdc-4149-bb6f-b2ac434456f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:32.335533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e59de-8cdc-4149-bb6f-b2ac434456f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:32.335930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e59de-8cdc-4149-bb6f-b2ac434456f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:32.336305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e59de-8cdc-4149-bb6f-b2ac434456f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:32.356529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:32.426415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e59de-8cdc-4149-bb6f-b2ac434456f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:32.427903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e59de-8cdc-4149-bb6f-b2ac434456f3 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:32.440683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1241/2491] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:35.336146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec531-10b6-4306-9fcc-8b0dc819ba77 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:35.543935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec531-10b6-4306-9fcc-8b0dc819ba77 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:35.558350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:35.559206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:35.559593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:35.559974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] PATH_INFO: `/v3/users/87b1c050ce0b45d7a454009dd42e0b03` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:35.561776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b1c050ce0b45d7a454009dd42e0b03)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:35.564927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:35.674668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b1c050ce0b45d7a454009dd42e0b03'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:35.679578 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b1c050ce0b45d7a454009dd42e0b03'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:35.693381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b1c050ce0b45d7a454009dd42e0b03'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:35.694413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b1c050ce0b45d7a454009dd42e0b03'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:35.716781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b1c050ce0b45d7a454009dd42e0b03'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:35.748691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1251/2492] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:35 2022] DELETE /identity/v3/users/87b1c050ce0b45d7a454009dd42e0b03 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:35.749609 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dbfb2-0cac-4a46-ab24-0db619168593 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:35.751369 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dbfb2-0cac-4a46-ab24-0db619168593 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:35.751369 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dbfb2-0cac-4a46-ab24-0db619168593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:35.798661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-043dbfb2-0cac-4a46-ab24-0db619168593 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:35.800075 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-043dbfb2-0cac-4a46-ab24-0db619168593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:35.881960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1242/2493] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:35.894769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:35.896406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:36.013631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:36.058399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fe8c5-6ce5-4a63-92bb-5e5674df6655 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:36.070255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732198b-a15a-4e9b-aade-fdda4a978825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:36.071152 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732198b-a15a-4e9b-aade-fdda4a978825 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:36.071299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732198b-a15a-4e9b-aade-fdda4a978825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:36.072213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732198b-a15a-4e9b-aade-fdda4a978825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:36.088779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732198b-a15a-4e9b-aade-fdda4a978825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:36.090534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732198b-a15a-4e9b-aade-fdda4a978825 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:36.104671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1252/2494] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:36.548259 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dbfb2-0cac-4a46-ab24-0db619168593 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:36.549710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-043dbfb2-0cac-4a46-ab24-0db619168593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:36.577329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dbfb2-0cac-4a46-ab24-0db619168593 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:36.593447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:36.594689 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:36.594983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:36.595257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] PATH_INFO: `/v3/projects/b8425771b6ab43e3bac2df0546723b7f` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:36.596432 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8425771b6ab43e3bac2df0546723b7f)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:36.598365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:36.688978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8425771b6ab43e3bac2df0546723b7f', 'request_id': 'req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:36.696651 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8425771b6ab43e3bac2df0546723b7f', 'request_id': 'req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:36.704706 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8425771b6ab43e3bac2df0546723b7f', 'request_id': 'req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:36.726149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] The token cache is being invalidate because project b8425771b6ab43e3bac2df0546723b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:36.726582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:36.727557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:36.729353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1243/2495] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:36 2022] DELETE /identity/v3/projects/b8425771b6ab43e3bac2df0546723b7f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:36.733158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732198b-a15a-4e9b-aade-fdda4a978825 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:36.745250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732198b-a15a-4e9b-aade-fdda4a978825 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:36.840871 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:36.841584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:36.841915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:36.842199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] PATH_INFO: `/v3/users/10818b1230ee4bccad54b8b35c2099ed` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:36.843517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10818b1230ee4bccad54b8b35c2099ed)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:36.845784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:36.970413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10818b1230ee4bccad54b8b35c2099ed'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:36.971279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10818b1230ee4bccad54b8b35c2099ed'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:36.991670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10818b1230ee4bccad54b8b35c2099ed'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:36.993539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10818b1230ee4bccad54b8b35c2099ed'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:37.019973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-32302058-0e8e-419d-9dbb-50a73ab8a212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10818b1230ee4bccad54b8b35c2099ed'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:37.043339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1253/2496] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:36 2022] DELETE /identity/v3/users/10818b1230ee4bccad54b8b35c2099ed => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:37.343263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:37.345541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:37.371522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb775815-95cd-47b9-8b0e-2fa6b4da9e29 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:37.419243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:37.454853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:37.454853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:37.454853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:37.454853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] PATH_INFO: `/v3/projects/41041d11b6c84f9fb3479d2c84bba518` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:37.455389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41041d11b6c84f9fb3479d2c84bba518)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:37.456978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:37.513203 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41041d11b6c84f9fb3479d2c84bba518', 'request_id': 'req-00fda9d1-5ff0-403e-a710-9e6f2010402c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:37.520989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41041d11b6c84f9fb3479d2c84bba518', 'request_id': 'req-00fda9d1-5ff0-403e-a710-9e6f2010402c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:37.528963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41041d11b6c84f9fb3479d2c84bba518', 'request_id': 'req-00fda9d1-5ff0-403e-a710-9e6f2010402c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:37.544947 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] The token cache is being invalidate because project 41041d11b6c84f9fb3479d2c84bba518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:37.545330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:37.546081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-00fda9d1-5ff0-403e-a710-9e6f2010402c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:37.551227 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1244/2497] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:37 2022] DELETE /identity/v3/projects/41041d11b6c84f9fb3479d2c84bba518 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:37.555949 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e7697-9af8-41f6-b907-b4b3514823d6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:37.556349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e7697-9af8-41f6-b907-b4b3514823d6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:37.556704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e7697-9af8-41f6-b907-b4b3514823d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:37.580419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-373e7697-9af8-41f6-b907-b4b3514823d6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:37.581760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-373e7697-9af8-41f6-b907-b4b3514823d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:37.643187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:37.654127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1254/2498] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:37.662617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a1053-45cf-4e65-b9f3-b98efea70602 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:37.663012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a1053-45cf-4e65-b9f3-b98efea70602 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:37.663291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a1053-45cf-4e65-b9f3-b98efea70602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:37.690638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2e4a1053-45cf-4e65-b9f3-b98efea70602 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:37.691919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2e4a1053-45cf-4e65-b9f3-b98efea70602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:37.702562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1245/2499] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:37.710091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e7697-9af8-41f6-b907-b4b3514823d6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:37.723099 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e7697-9af8-41f6-b907-b4b3514823d6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:37.734843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7ff4-4ce5-42b7-aeb6-43084347e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:37.735749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7ff4-4ce5-42b7-aeb6-43084347e10b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:37.736096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7ff4-4ce5-42b7-aeb6-43084347e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:37.736432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7ff4-4ce5-42b7-aeb6-43084347e10b admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:37.737150 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7ff4-4ce5-42b7-aeb6-43084347e10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:39:37.737514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7ff4-4ce5-42b7-aeb6-43084347e10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:37.739225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7ff4-4ce5-42b7-aeb6-43084347e10b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:37.757088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1255/2500] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:39:37.762988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a1053-45cf-4e65-b9f3-b98efea70602 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:37.777999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a1053-45cf-4e65-b9f3-b98efea70602 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:37.783914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bb018-5f76-4dc6-80a8-fa20a9ecbade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:37.784639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bb018-5f76-4dc6-80a8-fa20a9ecbade admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:37.785020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bb018-5f76-4dc6-80a8-fa20a9ecbade admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:37.785520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bb018-5f76-4dc6-80a8-fa20a9ecbade admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:37.786257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bb018-5f76-4dc6-80a8-fa20a9ecbade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:37.788356 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bb018-5f76-4dc6-80a8-fa20a9ecbade admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:37.830378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1246/2501] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:37 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:37.834621 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7ff4-4ce5-42b7-aeb6-43084347e10b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:37.848036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7ff4-4ce5-42b7-aeb6-43084347e10b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:37.933083 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96c267-757c-4dc2-94f2-d322bbb1817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:37.933711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c267-757c-4dc2-94f2-d322bbb1817a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:37.933972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c267-757c-4dc2-94f2-d322bbb1817a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:37.934240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c267-757c-4dc2-94f2-d322bbb1817a admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:37.934926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96c267-757c-4dc2-94f2-d322bbb1817a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:37.936841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96c267-757c-4dc2-94f2-d322bbb1817a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:37.975573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1256/2502] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:37 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:39:37.980176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bb018-5f76-4dc6-80a8-fa20a9ecbade admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:37.992304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bb018-5f76-4dc6-80a8-fa20a9ecbade admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:37.997236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06b344-8eb9-4df8-9e9b-78668fe20259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:37.997843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06b344-8eb9-4df8-9e9b-78668fe20259 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:37.998250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06b344-8eb9-4df8-9e9b-78668fe20259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:37.998526 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06b344-8eb9-4df8-9e9b-78668fe20259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:37.999303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06b344-8eb9-4df8-9e9b-78668fe20259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:38.001672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06b344-8eb9-4df8-9e9b-78668fe20259 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:38.019427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1247/2503] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:38.023810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96c267-757c-4dc2-94f2-d322bbb1817a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:38.038399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96c267-757c-4dc2-94f2-d322bbb1817a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:38.043594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703c117-498c-440e-ac1f-679bd07a0a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:38.044200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c117-498c-440e-ac1f-679bd07a0a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.044475 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c117-498c-440e-ac1f-679bd07a0a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.044750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c117-498c-440e-ac1f-679bd07a0a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.045380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703c117-498c-440e-ac1f-679bd07a0a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:38.047174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703c117-498c-440e-ac1f-679bd07a0a8c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:38.062916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1257/2504] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:38.064080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06b344-8eb9-4df8-9e9b-78668fe20259 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:38.076286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06b344-8eb9-4df8-9e9b-78668fe20259 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:38.085029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f826496-756a-48db-b4ee-ff30c4222871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:38.086203 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f826496-756a-48db-b4ee-ff30c4222871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.086697 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f826496-756a-48db-b4ee-ff30c4222871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.087120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f826496-756a-48db-b4ee-ff30c4222871 admin admin] PATH_INFO: `/v3/projects/3f58e138499541dda5bde4df07870625/users/7d56076cba1644018e498da4b1194754/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.105772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f826496-756a-48db-b4ee-ff30c4222871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f58e138499541dda5bde4df07870625, user_id=7d56076cba1644018e498da4b1194754, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:38.108559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f826496-756a-48db-b4ee-ff30c4222871 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:38.138187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1248/2505] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:38 2022] PUT /identity/v3/projects/3f58e138499541dda5bde4df07870625/users/7d56076cba1644018e498da4b1194754/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:38.146546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8e638-569a-4419-95fb-9b3acaa7c5e0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.146956 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8e638-569a-4419-95fb-9b3acaa7c5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.147505 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8e638-569a-4419-95fb-9b3acaa7c5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.182439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c0f8e638-569a-4419-95fb-9b3acaa7c5e0 None None] MFA Rules not processed for user `7d56076cba1644018e498da4b1194754`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:38.184119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c0f8e638-569a-4419-95fb-9b3acaa7c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:38.271474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1258/2506] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:38.277147 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f826496-756a-48db-b4ee-ff30c4222871 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:38.371962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f826496-756a-48db-b4ee-ff30c4222871 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:38.377570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c403bc-bd7c-4d5c-8895-111aee3591e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:38.379850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c403bc-bd7c-4d5c-8895-111aee3591e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.379850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c403bc-bd7c-4d5c-8895-111aee3591e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.379850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c403bc-bd7c-4d5c-8895-111aee3591e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.379850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c403bc-bd7c-4d5c-8895-111aee3591e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:38.381499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c403bc-bd7c-4d5c-8895-111aee3591e8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:38.392369 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:38.414082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1249/2507] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:38 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:38.417836 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8e638-569a-4419-95fb-9b3acaa7c5e0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:38.430479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8e638-569a-4419-95fb-9b3acaa7c5e0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:38.496778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:38.506076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21c858-a398-4a8a-980b-e8b76347cbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:38.509088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c858-a398-4a8a-980b-e8b76347cbbb admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.509451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c858-a398-4a8a-980b-e8b76347cbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.509809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c858-a398-4a8a-980b-e8b76347cbbb admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.510559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21c858-a398-4a8a-980b-e8b76347cbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:38.512679 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21c858-a398-4a8a-980b-e8b76347cbbb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:38.538803 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1259/2508] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:38 2022] POST /identity/v3/users => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:38.542839 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c403bc-bd7c-4d5c-8895-111aee3591e8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:38.554565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c403bc-bd7c-4d5c-8895-111aee3591e8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:38.559959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6010d-5209-4ad8-86ed-988d0ce3eb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:38.560552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6010d-5209-4ad8-86ed-988d0ce3eb02 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.560826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6010d-5209-4ad8-86ed-988d0ce3eb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.561091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6010d-5209-4ad8-86ed-988d0ce3eb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.561757 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6010d-5209-4ad8-86ed-988d0ce3eb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:38.563740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6010d-5209-4ad8-86ed-988d0ce3eb02 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:38.578480 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1250/2509] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:38.582660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21c858-a398-4a8a-980b-e8b76347cbbb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:38.593389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21c858-a398-4a8a-980b-e8b76347cbbb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:38.598966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7830d-8d4d-48f4-8953-13001fc19b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:38.599654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7830d-8d4d-48f4-8953-13001fc19b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.599958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7830d-8d4d-48f4-8953-13001fc19b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.600259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7830d-8d4d-48f4-8953-13001fc19b7e admin admin] PATH_INFO: `/v3/projects/9d921f29de164032b8745e41339bf5b6/users/ddf2ebd250d54f96ace2d9adcd58bb74/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.618628 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7830d-8d4d-48f4-8953-13001fc19b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d921f29de164032b8745e41339bf5b6, user_id=ddf2ebd250d54f96ace2d9adcd58bb74, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:38.621357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7830d-8d4d-48f4-8953-13001fc19b7e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:38.637320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1260/2510] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:38 2022] PUT /identity/v3/projects/9d921f29de164032b8745e41339bf5b6/users/ddf2ebd250d54f96ace2d9adcd58bb74/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:38.641677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6010d-5209-4ad8-86ed-988d0ce3eb02 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:38.653381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6010d-5209-4ad8-86ed-988d0ce3eb02 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:38.765485 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a552bae-5542-47ee-bbaa-d23809d00922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:38.766413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a552bae-5542-47ee-bbaa-d23809d00922 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.766539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a552bae-5542-47ee-bbaa-d23809d00922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.766846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a552bae-5542-47ee-bbaa-d23809d00922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.767533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a552bae-5542-47ee-bbaa-d23809d00922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:38.769419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a552bae-5542-47ee-bbaa-d23809d00922 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:38.782722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1251/2511] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:38.790491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7830d-8d4d-48f4-8953-13001fc19b7e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:38.806029 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7830d-8d4d-48f4-8953-13001fc19b7e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:38.810992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf7d52-3a1c-4eab-835c-384d10727c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:38.811746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7d52-3a1c-4eab-835c-384d10727c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.812093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7d52-3a1c-4eab-835c-384d10727c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.812529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7d52-3a1c-4eab-835c-384d10727c90 admin admin] PATH_INFO: `/v3/projects/9d921f29de164032b8745e41339bf5b6/users/ddf2ebd250d54f96ace2d9adcd58bb74/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.814583 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf7d52-3a1c-4eab-835c-384d10727c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d921f29de164032b8745e41339bf5b6, user_id=ddf2ebd250d54f96ace2d9adcd58bb74, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:38.817379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf7d52-3a1c-4eab-835c-384d10727c90 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:38.838175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1261/2512] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:38 2022] PUT /identity/v3/projects/9d921f29de164032b8745e41339bf5b6/users/ddf2ebd250d54f96ace2d9adcd58bb74/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:38.851445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03660fd5-bbfe-482a-9add-9af1a583c39e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.851728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03660fd5-bbfe-482a-9add-9af1a583c39e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.851982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03660fd5-bbfe-482a-9add-9af1a583c39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.880000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-03660fd5-bbfe-482a-9add-9af1a583c39e None None] MFA Rules not processed for user `ddf2ebd250d54f96ace2d9adcd58bb74`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:38.881208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-03660fd5-bbfe-482a-9add-9af1a583c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:38.969576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1252/2513] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:38.980525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf7d52-3a1c-4eab-835c-384d10727c90 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:38.982476 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-37bf7d52-3a1c-4eab-835c-384d10727c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:39.054019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf7d52-3a1c-4eab-835c-384d10727c90 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:39.061082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b955-bf0e-4085-809b-042f68d377cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:39.061839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b955-bf0e-4085-809b-042f68d377cc service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:39.062216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b955-bf0e-4085-809b-042f68d377cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:39.062879 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b955-bf0e-4085-809b-042f68d377cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:39.073267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425b955-bf0e-4085-809b-042f68d377cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:39.075227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425b955-bf0e-4085-809b-042f68d377cc service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:39.089416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1262/2514] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:38 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:39.255949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03660fd5-bbfe-482a-9add-9af1a583c39e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:39.332049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03660fd5-bbfe-482a-9add-9af1a583c39e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:39.340279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:39.341180 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:39.341322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:39.342269 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] PATH_INFO: `/v3/users/7d56076cba1644018e498da4b1194754` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:39.343088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d56076cba1644018e498da4b1194754)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:39.345152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:39.347016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:39.411065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d56076cba1644018e498da4b1194754'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:39.411874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d56076cba1644018e498da4b1194754'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:39.426248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d56076cba1644018e498da4b1194754'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:39.433657 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d56076cba1644018e498da4b1194754'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:39.434410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d56076cba1644018e498da4b1194754'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:39.456592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1253/2515] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:39 2022] DELETE /identity/v3/users/7d56076cba1644018e498da4b1194754 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:39.460903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc10cc7-0d1e-4422-a2d6-3305bc76a965 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:39.461190 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc10cc7-0d1e-4422-a2d6-3305bc76a965 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:39.461462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc10cc7-0d1e-4422-a2d6-3305bc76a965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:39.492031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cbc10cc7-0d1e-4422-a2d6-3305bc76a965 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:39.493742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cbc10cc7-0d1e-4422-a2d6-3305bc76a965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:39.571430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1263/2516] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:39.582873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:39.585027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:39.657552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821cafc-41ac-452d-bb97-c0fc0e8a0619 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:39.665093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ee10c-04be-4ea6-9825-c920532a4441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:39.665866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ee10c-04be-4ea6-9825-c920532a4441 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:39.666229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ee10c-04be-4ea6-9825-c920532a4441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:39.666620 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ee10c-04be-4ea6-9825-c920532a4441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:39.677677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ee10c-04be-4ea6-9825-c920532a4441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:39.679168 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ee10c-04be-4ea6-9825-c920532a4441 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:39.690329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1254/2517] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:40.044496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc10cc7-0d1e-4422-a2d6-3305bc76a965 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:40.047224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cbc10cc7-0d1e-4422-a2d6-3305bc76a965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:40.078352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc10cc7-0d1e-4422-a2d6-3305bc76a965 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:40.084028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:40.084772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:40.085188 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:40.085548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] PATH_INFO: `/v3/projects/3f58e138499541dda5bde4df07870625` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:40.086759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f58e138499541dda5bde4df07870625)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:40.089305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:40.146608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:40.149590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f58e138499541dda5bde4df07870625', 'request_id': 'req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:40.159366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f58e138499541dda5bde4df07870625', 'request_id': 'req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:40.186933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f58e138499541dda5bde4df07870625', 'request_id': 'req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:40.206388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] The token cache is being invalidate because project 3f58e138499541dda5bde4df07870625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:40.206700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:40.207363 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:40.208868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1264/2518] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:40 2022] DELETE /identity/v3/projects/3f58e138499541dda5bde4df07870625 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:40.212872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ee10c-04be-4ea6-9825-c920532a4441 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:40.226831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ee10c-04be-4ea6-9825-c920532a4441 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:40.303639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:40.303639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:40.303639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:40.303639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] PATH_INFO: `/v3/users/ddf2ebd250d54f96ace2d9adcd58bb74` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:40.304950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf2ebd250d54f96ace2d9adcd58bb74)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:40.306916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:40.351695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:40.395986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf2ebd250d54f96ace2d9adcd58bb74'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:40.396569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf2ebd250d54f96ace2d9adcd58bb74'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:40.411982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf2ebd250d54f96ace2d9adcd58bb74'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:40.426889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf2ebd250d54f96ace2d9adcd58bb74'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:40.427637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b28afe1d-b479-4b39-a0a8-0d5ac93b77d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf2ebd250d54f96ace2d9adcd58bb74'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:40.460020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1255/2519] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:40 2022] DELETE /identity/v3/users/ddf2ebd250d54f96ace2d9adcd58bb74 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:40.863401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:40.863626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:40.906970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1cd90-3ea9-4d32-ac32-84ce3f7fc4f1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:41.021011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:41.021652 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.021928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.022197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] PATH_INFO: `/v3/projects/9d921f29de164032b8745e41339bf5b6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.024270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d921f29de164032b8745e41339bf5b6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:41.027288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:41.106382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d921f29de164032b8745e41339bf5b6', 'request_id': 'req-2f50180a-d2d4-4552-95d9-31d62a5befbf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:41.115710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d921f29de164032b8745e41339bf5b6', 'request_id': 'req-2f50180a-d2d4-4552-95d9-31d62a5befbf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:41.122172 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d921f29de164032b8745e41339bf5b6', 'request_id': 'req-2f50180a-d2d4-4552-95d9-31d62a5befbf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:41.139305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] The token cache is being invalidate because project 9d921f29de164032b8745e41339bf5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:41.139869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:41.140720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2f50180a-d2d4-4552-95d9-31d62a5befbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:41.142476 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1265/2520] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:40 2022] DELETE /identity/v3/projects/9d921f29de164032b8745e41339bf5b6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:41.147831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178ed36-2c1e-44b3-bf63-37358afbaf9c None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.148198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178ed36-2c1e-44b3-bf63-37358afbaf9c None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.148471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178ed36-2c1e-44b3-bf63-37358afbaf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.177498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4178ed36-2c1e-44b3-bf63-37358afbaf9c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:41.178912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4178ed36-2c1e-44b3-bf63-37358afbaf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:41.283672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1256/2521] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:41.285366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0c5c2-2ad7-424d-be8b-459aa31d2211 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.285677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0c5c2-2ad7-424d-be8b-459aa31d2211 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.285960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0c5c2-2ad7-424d-be8b-459aa31d2211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.311470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2cb0c5c2-2ad7-424d-be8b-459aa31d2211 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:41.313648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2cb0c5c2-2ad7-424d-be8b-459aa31d2211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:41.329286 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1266/2522] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:41.330505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178ed36-2c1e-44b3-bf63-37358afbaf9c None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:41.345482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178ed36-2c1e-44b3-bf63-37358afbaf9c None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:41.350221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2916d15-46fc-442d-97dd-eba19eb939ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:41.351009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2916d15-46fc-442d-97dd-eba19eb939ba admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.351354 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2916d15-46fc-442d-97dd-eba19eb939ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.351632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2916d15-46fc-442d-97dd-eba19eb939ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.352379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2916d15-46fc-442d-97dd-eba19eb939ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:39:41.352681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2916d15-46fc-442d-97dd-eba19eb939ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:41.354312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2916d15-46fc-442d-97dd-eba19eb939ba admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:41.374458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1257/2523] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:39:41.377093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0c5c2-2ad7-424d-be8b-459aa31d2211 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:41.391314 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0c5c2-2ad7-424d-be8b-459aa31d2211 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:41.396877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6b514-e205-42a4-a5bc-de46c99406bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:41.397795 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6b514-e205-42a4-a5bc-de46c99406bf admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.398278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6b514-e205-42a4-a5bc-de46c99406bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.398779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6b514-e205-42a4-a5bc-de46c99406bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.399622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6b514-e205-42a4-a5bc-de46c99406bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:41.401997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6b514-e205-42a4-a5bc-de46c99406bf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:41.447210 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1267/2524] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:41 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:41.448398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2916d15-46fc-442d-97dd-eba19eb939ba admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:41.460359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2916d15-46fc-442d-97dd-eba19eb939ba admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:41.530529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfef41-b5b3-4878-8317-d2660978569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:41.532050 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfef41-b5b3-4878-8317-d2660978569a admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.532483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfef41-b5b3-4878-8317-d2660978569a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.532823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfef41-b5b3-4878-8317-d2660978569a admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.533559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfef41-b5b3-4878-8317-d2660978569a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:41.536985 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfef41-b5b3-4878-8317-d2660978569a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:41.565940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1258/2525] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:41 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:41.572331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6b514-e205-42a4-a5bc-de46c99406bf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:41.607123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6b514-e205-42a4-a5bc-de46c99406bf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:41.623082 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95760ef1-37f5-452a-a9c6-e97fa5f09bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:41.624649 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95760ef1-37f5-452a-a9c6-e97fa5f09bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.628326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95760ef1-37f5-452a-a9c6-e97fa5f09bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.628846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95760ef1-37f5-452a-a9c6-e97fa5f09bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.629755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95760ef1-37f5-452a-a9c6-e97fa5f09bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:41.632516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95760ef1-37f5-452a-a9c6-e97fa5f09bd1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:41.646517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1268/2526] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:41.652078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfef41-b5b3-4878-8317-d2660978569a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:41.669391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfef41-b5b3-4878-8317-d2660978569a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:41.680885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47551217-a317-4a42-bd19-31c66fddec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:41.681516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47551217-a317-4a42-bd19-31c66fddec89 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.681800 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47551217-a317-4a42-bd19-31c66fddec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.682077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47551217-a317-4a42-bd19-31c66fddec89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.682828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47551217-a317-4a42-bd19-31c66fddec89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:41.688822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47551217-a317-4a42-bd19-31c66fddec89 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:41.726762 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1259/2527] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:41.730899 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95760ef1-37f5-452a-a9c6-e97fa5f09bd1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:41.748877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95760ef1-37f5-452a-a9c6-e97fa5f09bd1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:41.759559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdf400-1de0-4cbd-a270-c0a3e8f42b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:41.760252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf400-1de0-4cbd-a270-c0a3e8f42b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.760530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf400-1de0-4cbd-a270-c0a3e8f42b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.760859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf400-1de0-4cbd-a270-c0a3e8f42b2a admin admin] PATH_INFO: `/v3/projects/b89baba7f7034e4b945a69cccc85f9a0/users/9b2693ee5bcc4ef19cd0e49af4ee33fb/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.789854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdf400-1de0-4cbd-a270-c0a3e8f42b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89baba7f7034e4b945a69cccc85f9a0, user_id=9b2693ee5bcc4ef19cd0e49af4ee33fb, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:41.792594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdf400-1de0-4cbd-a270-c0a3e8f42b2a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:41.804316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:41.810470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1269/2528] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:41 2022] PUT /identity/v3/projects/b89baba7f7034e4b945a69cccc85f9a0/users/9b2693ee5bcc4ef19cd0e49af4ee33fb/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:41.822285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b68d0-4145-4d9e-a682-39c69c776d48 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.822574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b68d0-4145-4d9e-a682-39c69c776d48 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.822877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b68d0-4145-4d9e-a682-39c69c776d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.847249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:41.869304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1a9b68d0-4145-4d9e-a682-39c69c776d48 None None] MFA Rules not processed for user `9b2693ee5bcc4ef19cd0e49af4ee33fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:41.870538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1a9b68d0-4145-4d9e-a682-39c69c776d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:41.965809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25b536-aa5b-45b2-a402-c8b149a59f25 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:41.966219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25b536-aa5b-45b2-a402-c8b149a59f25 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:41.966616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25b536-aa5b-45b2-a402-c8b149a59f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:41.968069 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1260/2529] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:41.974594 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b68d0-4145-4d9e-a682-39c69c776d48 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:42.014054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-da25b536-aa5b-45b2-a402-c8b149a59f25 None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:42.015485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-da25b536-aa5b-45b2-a402-c8b149a59f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:42.111162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b68d0-4145-4d9e-a682-39c69c776d48 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:42.111162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5dcb-b06d-4ee8-8237-f01cd4700d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:42.111162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5dcb-b06d-4ee8-8237-f01cd4700d70 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:42.111162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5dcb-b06d-4ee8-8237-f01cd4700d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:42.111637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5dcb-b06d-4ee8-8237-f01cd4700d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:42.111637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c5dcb-b06d-4ee8-8237-f01cd4700d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:42.112310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c5dcb-b06d-4ee8-8237-f01cd4700d70 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:42.121608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1270/2530] 10.222.0.23 () {58 vars in 967 bytes} [Tue Oct 4 08:39:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:42.157968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25b536-aa5b-45b2-a402-c8b149a59f25 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:42.163905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-da25b536-aa5b-45b2-a402-c8b149a59f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:42.182730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1261/2531] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:41 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:39:42.185912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5dcb-b06d-4ee8-8237-f01cd4700d70 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:42.253262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25b536-aa5b-45b2-a402-c8b149a59f25 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:42.262199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5dcb-b06d-4ee8-8237-f01cd4700d70 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:42.274730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad834c8-890a-4951-b0dd-2dc0dd592841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:42.274730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad834c8-890a-4951-b0dd-2dc0dd592841 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:42.274730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad834c8-890a-4951-b0dd-2dc0dd592841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:42.274730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad834c8-890a-4951-b0dd-2dc0dd592841 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:42.275297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad834c8-890a-4951-b0dd-2dc0dd592841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:42.284512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad834c8-890a-4951-b0dd-2dc0dd592841 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:42.348394 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540a234-228a-4d8e-87b6-8c5b54b90274 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:42.349303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a234-228a-4d8e-87b6-8c5b54b90274 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:42.349708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a234-228a-4d8e-87b6-8c5b54b90274 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:42.350040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a234-228a-4d8e-87b6-8c5b54b90274 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:42.358720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1262/2532] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:42 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:39:42.361760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad834c8-890a-4951-b0dd-2dc0dd592841 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:42.372608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad834c8-890a-4951-b0dd-2dc0dd592841 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:42.378609 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92de40-444d-4e55-9814-ef4d8651cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:42.379158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92de40-444d-4e55-9814-ef4d8651cd62 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:42.379349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92de40-444d-4e55-9814-ef4d8651cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:42.379621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92de40-444d-4e55-9814-ef4d8651cd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:42.380272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92de40-444d-4e55-9814-ef4d8651cd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:42.381864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92de40-444d-4e55-9814-ef4d8651cd62 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:42.388101 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:42.394209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1263/2533] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:42.398858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92de40-444d-4e55-9814-ef4d8651cd62 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:42.410981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92de40-444d-4e55-9814-ef4d8651cd62 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:42.416191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb631e-6f76-46af-b1e6-917b1b805380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:42.417414 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb631e-6f76-46af-b1e6-917b1b805380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:42.417776 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb631e-6f76-46af-b1e6-917b1b805380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:42.418132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb631e-6f76-46af-b1e6-917b1b805380 admin admin] PATH_INFO: `/v3/projects/6bae4f9bc7144cecbda2692bfc130cec/users/0b5994c39bc048478b1d063e24a9ec0f/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:42.428512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:42.438902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb631e-6f76-46af-b1e6-917b1b805380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bae4f9bc7144cecbda2692bfc130cec, user_id=0b5994c39bc048478b1d063e24a9ec0f, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:42.441821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb631e-6f76-46af-b1e6-917b1b805380 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:42.442828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540a234-228a-4d8e-87b6-8c5b54b90274 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:42.444492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540a234-228a-4d8e-87b6-8c5b54b90274 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:42.455616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1271/2534] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:39:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:39:42.463744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1264/2535] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:42 2022] PUT /identity/v3/projects/6bae4f9bc7144cecbda2692bfc130cec/users/0b5994c39bc048478b1d063e24a9ec0f/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:39:42.468149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540a234-228a-4d8e-87b6-8c5b54b90274 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:42.480935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540a234-228a-4d8e-87b6-8c5b54b90274 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:42.545298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b879fa-6957-43f7-ba78-87690399bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:42.545915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b879fa-6957-43f7-ba78-87690399bce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:42.546202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b879fa-6957-43f7-ba78-87690399bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:42.546506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b879fa-6957-43f7-ba78-87690399bce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:42.547329 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b879fa-6957-43f7-ba78-87690399bce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:42.548941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b879fa-6957-43f7-ba78-87690399bce5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:42.564829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1272/2536] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:42.566087 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb631e-6f76-46af-b1e6-917b1b805380 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:42.577461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb631e-6f76-46af-b1e6-917b1b805380 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:42.585330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9913c8-de10-47cf-b3a5-7485f0d7eaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:42.586105 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9913c8-de10-47cf-b3a5-7485f0d7eaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:42.586386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9913c8-de10-47cf-b3a5-7485f0d7eaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:42.586668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9913c8-de10-47cf-b3a5-7485f0d7eaf1 admin admin] PATH_INFO: `/v3/projects/6bae4f9bc7144cecbda2692bfc130cec/users/0b5994c39bc048478b1d063e24a9ec0f/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:42.589287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9913c8-de10-47cf-b3a5-7485f0d7eaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bae4f9bc7144cecbda2692bfc130cec, user_id=0b5994c39bc048478b1d063e24a9ec0f, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:42.592219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9913c8-de10-47cf-b3a5-7485f0d7eaf1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:42.618714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1265/2537] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:42 2022] PUT /identity/v3/projects/6bae4f9bc7144cecbda2692bfc130cec/users/0b5994c39bc048478b1d063e24a9ec0f/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:39:42.678566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43882cd3-acc2-4bf1-b097-03e3d30e63e3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:42.678887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43882cd3-acc2-4bf1-b097-03e3d30e63e3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:42.679165 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43882cd3-acc2-4bf1-b097-03e3d30e63e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:42.712847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-43882cd3-acc2-4bf1-b097-03e3d30e63e3 None None] MFA Rules not processed for user `0b5994c39bc048478b1d063e24a9ec0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:42.714167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-43882cd3-acc2-4bf1-b097-03e3d30e63e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:42.816054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1273/2538] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:42.820183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9913c8-de10-47cf-b3a5-7485f0d7eaf1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:42.822272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5d9913c8-de10-47cf-b3a5-7485f0d7eaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:42.829157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43882cd3-acc2-4bf1-b097-03e3d30e63e3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:42.835689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-43882cd3-acc2-4bf1-b097-03e3d30e63e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:42.897464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9913c8-de10-47cf-b3a5-7485f0d7eaf1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:42.902007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e01c9-7965-47b5-a837-b5d382628d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:42.902895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e01c9-7965-47b5-a837-b5d382628d27 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:42.903413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e01c9-7965-47b5-a837-b5d382628d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:42.903910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e01c9-7965-47b5-a837-b5d382628d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:42.906476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-560e01c9-7965-47b5-a837-b5d382628d27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:42.932907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43882cd3-acc2-4bf1-b097-03e3d30e63e3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:42.937117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9419a-730f-4b17-8df3-a16f5ffaa9a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:42.937843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9419a-730f-4b17-8df3-a16f5ffaa9a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:42.938224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9419a-730f-4b17-8df3-a16f5ffaa9a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:42.938594 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9419a-730f-4b17-8df3-a16f5ffaa9a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:42.949038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9419a-730f-4b17-8df3-a16f5ffaa9a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:42.950832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9419a-730f-4b17-8df3-a16f5ffaa9a6 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:42.966498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1274/2539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:43.028902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e01c9-7965-47b5-a837-b5d382628d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:43.031035 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e01c9-7965-47b5-a837-b5d382628d27 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:43.049956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1266/2540] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:39:43.069311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9419a-730f-4b17-8df3-a16f5ffaa9a6 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:43.081435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9419a-730f-4b17-8df3-a16f5ffaa9a6 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:43.085215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a76436-aed0-4dd4-843f-db5f552a3aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:43.085827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a76436-aed0-4dd4-843f-db5f552a3aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:43.086143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a76436-aed0-4dd4-843f-db5f552a3aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:43.086379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a76436-aed0-4dd4-843f-db5f552a3aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:43.116517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:43.206201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a76436-aed0-4dd4-843f-db5f552a3aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:43.208063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a76436-aed0-4dd4-843f-db5f552a3aa5 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:43.222465 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1275/2541] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:43.536124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e01c9-7965-47b5-a837-b5d382628d27 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:43.600988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e01c9-7965-47b5-a837-b5d382628d27 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:43.606140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:43.607327 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:43.607633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:43.608188 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] PATH_INFO: `/v3/users/9b2693ee5bcc4ef19cd0e49af4ee33fb` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:43.610224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2693ee5bcc4ef19cd0e49af4ee33fb)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:43.612461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:43.617853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:43.662975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2693ee5bcc4ef19cd0e49af4ee33fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:43.663627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2693ee5bcc4ef19cd0e49af4ee33fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:43.678061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2693ee5bcc4ef19cd0e49af4ee33fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:43.684888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2693ee5bcc4ef19cd0e49af4ee33fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:43.685606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2693ee5bcc4ef19cd0e49af4ee33fb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:43.709892 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1267/2542] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:43 2022] DELETE /identity/v3/users/9b2693ee5bcc4ef19cd0e49af4ee33fb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:43.715431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0333f9-1b3e-40ba-b1c0-979499117621 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:43.715721 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0333f9-1b3e-40ba-b1c0-979499117621 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:43.716001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0333f9-1b3e-40ba-b1c0-979499117621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:43.740670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9e0333f9-1b3e-40ba-b1c0-979499117621 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:43.741898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e0333f9-1b3e-40ba-b1c0-979499117621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:43.816759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1276/2543] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:43.826788 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:43.829512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:43.899514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2ec3e-9c10-47d7-a6ad-a5c229c96091 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:43.903478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bad43-f550-4329-9cf4-3f5c76a3fd17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:43.904085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bad43-f550-4329-9cf4-3f5c76a3fd17 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:43.904361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bad43-f550-4329-9cf4-3f5c76a3fd17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:43.904631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bad43-f550-4329-9cf4-3f5c76a3fd17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:43.914521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bad43-f550-4329-9cf4-3f5c76a3fd17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:43.916004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bad43-f550-4329-9cf4-3f5c76a3fd17 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:43.926702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1268/2544] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:44.393788 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0333f9-1b3e-40ba-b1c0-979499117621 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:44.419087 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0333f9-1b3e-40ba-b1c0-979499117621 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:44.423844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413440e-0639-42e7-9f7c-c790399a44d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:44.424755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413440e-0639-42e7-9f7c-c790399a44d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:44.425253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413440e-0639-42e7-9f7c-c790399a44d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:44.425838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413440e-0639-42e7-9f7c-c790399a44d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:44.428279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7413440e-0639-42e7-9f7c-c790399a44d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:44.442171 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bad43-f550-4329-9cf4-3f5c76a3fd17 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:44.443629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c93bad43-f550-4329-9cf4-3f5c76a3fd17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:44.470497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bad43-f550-4329-9cf4-3f5c76a3fd17 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:44.482916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:44.483572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:44.484362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:44.484644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] PATH_INFO: `/v3/projects/b89baba7f7034e4b945a69cccc85f9a0` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:44.487559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89baba7f7034e4b945a69cccc85f9a0)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:44.489643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:44.570928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89baba7f7034e4b945a69cccc85f9a0', 'request_id': 'req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:44.575512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413440e-0639-42e7-9f7c-c790399a44d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:44.577335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413440e-0639-42e7-9f7c-c790399a44d9 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:44.577478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89baba7f7034e4b945a69cccc85f9a0', 'request_id': 'req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:44.587230 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89baba7f7034e4b945a69cccc85f9a0', 'request_id': 'req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:44.602235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1277/2545] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:44.604700 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] The token cache is being invalidate because project b89baba7f7034e4b945a69cccc85f9a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:44.605076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:44.605819 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:44.608303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1269/2546] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:44 2022] DELETE /identity/v3/projects/b89baba7f7034e4b945a69cccc85f9a0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:44.611683 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413440e-0639-42e7-9f7c-c790399a44d9 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:44.623312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413440e-0639-42e7-9f7c-c790399a44d9 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:44.666974 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:44.698196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:44.699297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:44.700384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:44.701647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] PATH_INFO: `/v3/users/0b5994c39bc048478b1d063e24a9ec0f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:44.703798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5994c39bc048478b1d063e24a9ec0f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:44.706322 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:44.769116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5994c39bc048478b1d063e24a9ec0f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:44.770157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5994c39bc048478b1d063e24a9ec0f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:44.779235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5994c39bc048478b1d063e24a9ec0f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:44.780541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5994c39bc048478b1d063e24a9ec0f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:44.800485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b20da55c-e844-4ad4-a08e-3103cca09643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5994c39bc048478b1d063e24a9ec0f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:44.817853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1278/2547] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:44 2022] DELETE /identity/v3/users/0b5994c39bc048478b1d063e24a9ec0f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:45.326081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:45.328365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:45.348030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cc6a3-ce7f-4b71-8d97-8554c0f33529 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:45.353224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:45.422814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:45.423584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:45.423965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:45.424420 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] PATH_INFO: `/v3/projects/6bae4f9bc7144cecbda2692bfc130cec` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:45.425863 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bae4f9bc7144cecbda2692bfc130cec)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:45.428186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:45.500283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bae4f9bc7144cecbda2692bfc130cec', 'request_id': 'req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:45.507384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bae4f9bc7144cecbda2692bfc130cec', 'request_id': 'req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:45.513492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bae4f9bc7144cecbda2692bfc130cec', 'request_id': 'req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:45.528952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] The token cache is being invalidate because project 6bae4f9bc7144cecbda2692bfc130cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:45.529375 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:45.530236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-92a4287f-20c9-4d01-8dfe-a98aa7c05c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:45.532129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1270/2548] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:45 2022] DELETE /identity/v3/projects/6bae4f9bc7144cecbda2692bfc130cec => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:45.536955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1e87a-bf57-446b-9b0d-e406c845471b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:45.537473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1e87a-bf57-446b-9b0d-e406c845471b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:45.537764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1e87a-bf57-446b-9b0d-e406c845471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:45.566935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8cf1e87a-bf57-446b-9b0d-e406c845471b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:45.568346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8cf1e87a-bf57-446b-9b0d-e406c845471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:45.630362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1279/2549] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:45.638385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0bff7-d8b7-482d-aa1b-3c7cedb16474 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:45.638904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0bff7-d8b7-482d-aa1b-3c7cedb16474 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:45.639028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0bff7-d8b7-482d-aa1b-3c7cedb16474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:45.661998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-75f0bff7-d8b7-482d-aa1b-3c7cedb16474 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:45.663272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-75f0bff7-d8b7-482d-aa1b-3c7cedb16474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:45.671590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1271/2550] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:45.675881 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1e87a-bf57-446b-9b0d-e406c845471b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:45.685585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1e87a-bf57-446b-9b0d-e406c845471b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:45.691595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e737eb5-13a4-41d7-8feb-3a0d4ffbecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:45.692206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e737eb5-13a4-41d7-8feb-3a0d4ffbecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:45.692489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e737eb5-13a4-41d7-8feb-3a0d4ffbecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:45.692763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e737eb5-13a4-41d7-8feb-3a0d4ffbecb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:45.693410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e737eb5-13a4-41d7-8feb-3a0d4ffbecb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:39:45.693715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e737eb5-13a4-41d7-8feb-3a0d4ffbecb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:45.695383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e737eb5-13a4-41d7-8feb-3a0d4ffbecb9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:45.710601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1280/2551] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:39:45.715383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0bff7-d8b7-482d-aa1b-3c7cedb16474 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:45.726825 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0bff7-d8b7-482d-aa1b-3c7cedb16474 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:45.731748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d159-0b26-4413-a838-2e7665218494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:45.732353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d159-0b26-4413-a838-2e7665218494 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:45.732625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d159-0b26-4413-a838-2e7665218494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:45.732894 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d159-0b26-4413-a838-2e7665218494 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:45.733531 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d159-0b26-4413-a838-2e7665218494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:45.735452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d159-0b26-4413-a838-2e7665218494 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:45.767884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1272/2552] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:45 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:39:45.772199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e737eb5-13a4-41d7-8feb-3a0d4ffbecb9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:45.783139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e737eb5-13a4-41d7-8feb-3a0d4ffbecb9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:45.826216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:45.844250 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320f286-4566-496a-ad35-fe350b5bb4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:45.844856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320f286-4566-496a-ad35-fe350b5bb4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:45.845163 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320f286-4566-496a-ad35-fe350b5bb4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:45.845412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320f286-4566-496a-ad35-fe350b5bb4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:45.846047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320f286-4566-496a-ad35-fe350b5bb4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:45.848139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320f286-4566-496a-ad35-fe350b5bb4e8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:45.881453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1281/2553] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:45 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:45.882885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d159-0b26-4413-a838-2e7665218494 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:45.896553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d159-0b26-4413-a838-2e7665218494 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:45.911039 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67975d6f-447f-469a-abbb-9b4b02e6ea36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:45.911681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67975d6f-447f-469a-abbb-9b4b02e6ea36 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:45.911979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67975d6f-447f-469a-abbb-9b4b02e6ea36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:45.912248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67975d6f-447f-469a-abbb-9b4b02e6ea36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:45.912880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67975d6f-447f-469a-abbb-9b4b02e6ea36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:45.914522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67975d6f-447f-469a-abbb-9b4b02e6ea36 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:45.940982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1273/2554] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:45.943540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320f286-4566-496a-ad35-fe350b5bb4e8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:45.958852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320f286-4566-496a-ad35-fe350b5bb4e8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:45.966746 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf90d64-4baf-46bc-9110-8d00fd6d7f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:45.967381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf90d64-4baf-46bc-9110-8d00fd6d7f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:45.967668 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf90d64-4baf-46bc-9110-8d00fd6d7f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:45.967944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf90d64-4baf-46bc-9110-8d00fd6d7f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:45.969763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf90d64-4baf-46bc-9110-8d00fd6d7f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:45.971466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf90d64-4baf-46bc-9110-8d00fd6d7f60 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:45.983396 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1282/2555] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:45.988459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67975d6f-447f-469a-abbb-9b4b02e6ea36 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:46.001389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67975d6f-447f-469a-abbb-9b4b02e6ea36 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:46.006950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e844ca-9d77-45b6-9fde-1abde6861ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:46.007606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e844ca-9d77-45b6-9fde-1abde6861ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:46.007884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e844ca-9d77-45b6-9fde-1abde6861ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:46.008154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e844ca-9d77-45b6-9fde-1abde6861ccc admin admin] PATH_INFO: `/v3/projects/bf4cf7ed33c4452d9f11edf58d8e46f0/users/09d59ef21d214b6fba670d1449d887f5/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:46.024879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e844ca-9d77-45b6-9fde-1abde6861ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4cf7ed33c4452d9f11edf58d8e46f0, user_id=09d59ef21d214b6fba670d1449d887f5, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:46.027895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e844ca-9d77-45b6-9fde-1abde6861ccc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:46.044048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1274/2556] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:45 2022] PUT /identity/v3/projects/bf4cf7ed33c4452d9f11edf58d8e46f0/users/09d59ef21d214b6fba670d1449d887f5/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:46.050163 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84261b-dc82-4835-81b0-0be4b336d1d1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:46.050478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84261b-dc82-4835-81b0-0be4b336d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:46.050791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84261b-dc82-4835-81b0-0be4b336d1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:46.074953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dd84261b-dc82-4835-81b0-0be4b336d1d1 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:46.076178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dd84261b-dc82-4835-81b0-0be4b336d1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:46.144468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1283/2557] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:46.151647 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e844ca-9d77-45b6-9fde-1abde6861ccc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:46.153870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-06e844ca-9d77-45b6-9fde-1abde6861ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:46.201045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:46.221190 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e844ca-9d77-45b6-9fde-1abde6861ccc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:46.224932 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c630f-379a-4f56-92db-b6073ca0ab51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:46.225551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c630f-379a-4f56-92db-b6073ca0ab51 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:46.225826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c630f-379a-4f56-92db-b6073ca0ab51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:46.226100 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c630f-379a-4f56-92db-b6073ca0ab51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:46.239912 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c630f-379a-4f56-92db-b6073ca0ab51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:46.241403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c630f-379a-4f56-92db-b6073ca0ab51 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:46.252312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1275/2558] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:39:47.622889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ca18f-fb14-4e10-8697-b496d1dc9d83 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:47.623796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ca18f-fb14-4e10-8697-b496d1dc9d83 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:47.624418 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ca18f-fb14-4e10-8697-b496d1dc9d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:47.712600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-450ca18f-fb14-4e10-8697-b496d1dc9d83 None None] MFA Rules not processed for user `09d59ef21d214b6fba670d1449d887f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:47.714108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-450ca18f-fb14-4e10-8697-b496d1dc9d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:47.803968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1284/2559] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:47.817889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c630f-379a-4f56-92db-b6073ca0ab51 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:47.819833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-801c630f-379a-4f56-92db-b6073ca0ab51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:47.902214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c630f-379a-4f56-92db-b6073ca0ab51 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:47.907187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e06a08-9902-44bc-8808-a48780c5fbbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:47.907811 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06a08-9902-44bc-8808-a48780c5fbbd service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:47.908092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06a08-9902-44bc-8808-a48780c5fbbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:47.908517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06a08-9902-44bc-8808-a48780c5fbbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:47.919687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e06a08-9902-44bc-8808-a48780c5fbbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:47.922057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e06a08-9902-44bc-8808-a48780c5fbbd service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:47.932590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1276/2560] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:49.485967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf7415-b3cb-46f1-aa41-df784796cf42 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:49.486548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf7415-b3cb-46f1-aa41-df784796cf42 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:49.486548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf7415-b3cb-46f1-aa41-df784796cf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:49.509204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f6cf7415-b3cb-46f1-aa41-df784796cf42 None None] MFA Rules not processed for user `09d59ef21d214b6fba670d1449d887f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:49.510416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f6cf7415-b3cb-46f1-aa41-df784796cf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:49.522419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1285/2561] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:51.351210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e06a08-9902-44bc-8808-a48780c5fbbd service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:51.352707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-33e06a08-9902-44bc-8808-a48780c5fbbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:51.411943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e06a08-9902-44bc-8808-a48780c5fbbd service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:51.416061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9319e-85f0-4a48-b91b-53284eb72230 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b2324f9166d4c2dac76f08b03991769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:51.416700 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9319e-85f0-4a48-b91b-53284eb72230 service glance] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:51.416957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9319e-85f0-4a48-b91b-53284eb72230 service glance] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:51.417254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9319e-85f0-4a48-b91b-53284eb72230 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:51.419026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d6b9319e-85f0-4a48-b91b-53284eb72230 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:51.503095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9319e-85f0-4a48-b91b-53284eb72230 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:51.504929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9319e-85f0-4a48-b91b-53284eb72230 service glance] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:51.514388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1277/2562] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:51.678062 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf7415-b3cb-46f1-aa41-df784796cf42 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:51.679544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f6cf7415-b3cb-46f1-aa41-df784796cf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:51.696086 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf7415-b3cb-46f1-aa41-df784796cf42 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:51.708402 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:51.709056 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:51.709385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:51.709666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] PATH_INFO: `/v3/users/75b4a567370b49d1ba6f96df50638d86` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:51.710915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b4a567370b49d1ba6f96df50638d86)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:51.713019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:51.770339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:51.777371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10357e3e-6fe0-4165-ae9c-b63dbe13ad4d None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:51.777573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10357e3e-6fe0-4165-ae9c-b63dbe13ad4d None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:51.778580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10357e3e-6fe0-4165-ae9c-b63dbe13ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:51.780481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b4a567370b49d1ba6f96df50638d86'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:51.781138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b4a567370b49d1ba6f96df50638d86'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:51.791075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b4a567370b49d1ba6f96df50638d86'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:51.792186 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b4a567370b49d1ba6f96df50638d86'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:51.803256 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-10357e3e-6fe0-4165-ae9c-b63dbe13ad4d None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:51.804951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-10357e3e-6fe0-4165-ae9c-b63dbe13ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:51.809185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b4a567370b49d1ba6f96df50638d86'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:51.836214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1286/2563] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:51 2022] DELETE /identity/v3/users/75b4a567370b49d1ba6f96df50638d86 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:51.843253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:51.871702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1278/2564] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Oct 4 08:39:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:51.892695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:51.894129 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:51.977757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce844-cd82-42cd-82a5-efdd1b6338f6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:51.984409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288a57-71d8-487a-8235-2c83db134093 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:51.984409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288a57-71d8-487a-8235-2c83db134093 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:51.984790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288a57-71d8-487a-8235-2c83db134093 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:51.984981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288a57-71d8-487a-8235-2c83db134093 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:52.034853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10357e3e-6fe0-4165-ae9c-b63dbe13ad4d None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:52.036408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-10357e3e-6fe0-4165-ae9c-b63dbe13ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:52.054584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10357e3e-6fe0-4165-ae9c-b63dbe13ad4d None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:52.073315 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a288a57-71d8-487a-8235-2c83db134093 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:52.075043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a288a57-71d8-487a-8235-2c83db134093 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:52.092143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1287/2565] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:39:52.121051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:52.122213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:52.122782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:52.123149 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] PATH_INFO: `/v3/projects/06306d17d2a94502bd655dfc69937d34` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:52.124399 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06306d17d2a94502bd655dfc69937d34)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:52.126610 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:52.192411 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06306d17d2a94502bd655dfc69937d34', 'request_id': 'req-e4b81246-7171-446f-96c1-f58558784417'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:52.210120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06306d17d2a94502bd655dfc69937d34', 'request_id': 'req-e4b81246-7171-446f-96c1-f58558784417'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:52.218695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06306d17d2a94502bd655dfc69937d34', 'request_id': 'req-e4b81246-7171-446f-96c1-f58558784417'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:52.235817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] The token cache is being invalidate because project 06306d17d2a94502bd655dfc69937d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:52.236302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:52.237297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:52.239564 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1279/2566] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:52 2022] DELETE /identity/v3/projects/06306d17d2a94502bd655dfc69937d34 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:39:52.243669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288a57-71d8-487a-8235-2c83db134093 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:52.266687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288a57-71d8-487a-8235-2c83db134093 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:52.385625 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:52.386456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:52.386939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:52.387313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] PATH_INFO: `/v3/users/d9f87c7edfd44283b5a892a5dce3c321` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:52.388926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f87c7edfd44283b5a892a5dce3c321)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:52.392226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:52.394427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:52.490331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f87c7edfd44283b5a892a5dce3c321'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:52.491048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f87c7edfd44283b5a892a5dce3c321'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:52.498742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f87c7edfd44283b5a892a5dce3c321'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:52.501235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f87c7edfd44283b5a892a5dce3c321'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:52.517609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c837324-57fd-49ca-af8e-3f2f2f166846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f87c7edfd44283b5a892a5dce3c321'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:52.539905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1288/2567] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:39:52 2022] DELETE /identity/v3/users/d9f87c7edfd44283b5a892a5dce3c321 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:52.765138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:52.766880 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:52.784710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b81246-7171-446f-96c1-f58558784417 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:52.897810 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:52.898784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:52.899098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:52.899402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] PATH_INFO: `/v3/projects/54d11209fc5342bdbfc9dd50d347484a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:52.901106 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d11209fc5342bdbfc9dd50d347484a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:52.904570 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:52.924092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:52.998978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d11209fc5342bdbfc9dd50d347484a', 'request_id': 'req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:53.010264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d11209fc5342bdbfc9dd50d347484a', 'request_id': 'req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:53.019677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d11209fc5342bdbfc9dd50d347484a', 'request_id': 'req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:53.041239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] The token cache is being invalidate because project 54d11209fc5342bdbfc9dd50d347484a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:39:53.041860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:53.043095 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b2b3bc0f-a293-4532-b03f-f04f587b9f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:39:53.044885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1280/2568] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:39:52 2022] DELETE /identity/v3/projects/54d11209fc5342bdbfc9dd50d347484a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:39:53.056160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213c82-c430-4b1b-a8a1-e842454269b6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:53.057432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213c82-c430-4b1b-a8a1-e842454269b6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:53.057862 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213c82-c430-4b1b-a8a1-e842454269b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:53.086573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dd213c82-c430-4b1b-a8a1-e842454269b6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:53.088299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dd213c82-c430-4b1b-a8a1-e842454269b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:53.181185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1289/2569] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:53.188159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b981e3-8cfb-43eb-9b27-be10b5ee6d68 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:53.188449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b981e3-8cfb-43eb-9b27-be10b5ee6d68 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:53.188728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b981e3-8cfb-43eb-9b27-be10b5ee6d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:53.233746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-03b981e3-8cfb-43eb-9b27-be10b5ee6d68 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:53.235382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-03b981e3-8cfb-43eb-9b27-be10b5ee6d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:53.248528 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1281/2570] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:53.250260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd213c82-c430-4b1b-a8a1-e842454269b6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:53.261968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd213c82-c430-4b1b-a8a1-e842454269b6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:53.269144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193ffc0-bf69-4626-a848-c713f3e08ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:53.269848 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193ffc0-bf69-4626-a848-c713f3e08ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:53.270130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193ffc0-bf69-4626-a848-c713f3e08ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:53.270406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193ffc0-bf69-4626-a848-c713f3e08ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:53.271100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193ffc0-bf69-4626-a848-c713f3e08ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:39:53.271408 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193ffc0-bf69-4626-a848-c713f3e08ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:53.273080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193ffc0-bf69-4626-a848-c713f3e08ff5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:53.290739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1290/2571] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:39:53.292136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b981e3-8cfb-43eb-9b27-be10b5ee6d68 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:53.303083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b981e3-8cfb-43eb-9b27-be10b5ee6d68 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:53.309684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f461aa6-6360-44c2-a188-19faebcc34ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:53.315064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461aa6-6360-44c2-a188-19faebcc34ba admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:53.315461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461aa6-6360-44c2-a188-19faebcc34ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:53.315870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461aa6-6360-44c2-a188-19faebcc34ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:53.316549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f461aa6-6360-44c2-a188-19faebcc34ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:53.318486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f461aa6-6360-44c2-a188-19faebcc34ba admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:53.361249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1282/2572] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:39:53 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:53.365536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193ffc0-bf69-4626-a848-c713f3e08ff5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:53.382855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193ffc0-bf69-4626-a848-c713f3e08ff5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:53.485480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c928d1-daed-4a98-baff-23602c36e7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:53.487165 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c928d1-daed-4a98-baff-23602c36e7db admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:53.487734 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c928d1-daed-4a98-baff-23602c36e7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:53.488608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c928d1-daed-4a98-baff-23602c36e7db admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:53.489742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c928d1-daed-4a98-baff-23602c36e7db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:53.492383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c928d1-daed-4a98-baff-23602c36e7db admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:53.507258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:53.528807 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1291/2573] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:39:53 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:39:53.531141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f461aa6-6360-44c2-a188-19faebcc34ba admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:53.543521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f461aa6-6360-44c2-a188-19faebcc34ba admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:53.550422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13425b-c810-4da5-8268-fd0406da21ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:53.551171 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13425b-c810-4da5-8268-fd0406da21ea admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:53.551477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13425b-c810-4da5-8268-fd0406da21ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:53.551849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13425b-c810-4da5-8268-fd0406da21ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:53.552562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13425b-c810-4da5-8268-fd0406da21ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:53.554309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13425b-c810-4da5-8268-fd0406da21ea admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:53.566379 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1283/2574] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:39:53.570416 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c928d1-daed-4a98-baff-23602c36e7db admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:53.580605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c928d1-daed-4a98-baff-23602c36e7db admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:53.589797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adac3d-8bc9-465d-b739-d96b89bb7338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:53.590434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adac3d-8bc9-465d-b739-d96b89bb7338 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:53.590744 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adac3d-8bc9-465d-b739-d96b89bb7338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:53.591026 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adac3d-8bc9-465d-b739-d96b89bb7338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:53.592031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adac3d-8bc9-465d-b739-d96b89bb7338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:53.594003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adac3d-8bc9-465d-b739-d96b89bb7338 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:53.610917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1292/2575] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:39:53.612389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13425b-c810-4da5-8268-fd0406da21ea admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:53.626166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13425b-c810-4da5-8268-fd0406da21ea admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:53.635524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b7981-faca-40dd-b2e4-5cbd73f2452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:53.638556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b7981-faca-40dd-b2e4-5cbd73f2452e admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:53.639141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b7981-faca-40dd-b2e4-5cbd73f2452e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:53.639680 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b7981-faca-40dd-b2e4-5cbd73f2452e admin admin] PATH_INFO: `/v3/projects/fd2f06d8aa5d442d9154b75383100fcf/users/0ecdf8d355ca48d68275939352863294/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:53.662925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b7981-faca-40dd-b2e4-5cbd73f2452e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2f06d8aa5d442d9154b75383100fcf, user_id=0ecdf8d355ca48d68275939352863294, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:53.665961 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b7981-faca-40dd-b2e4-5cbd73f2452e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:53.681617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1284/2576] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:39:53 2022] PUT /identity/v3/projects/fd2f06d8aa5d442d9154b75383100fcf/users/0ecdf8d355ca48d68275939352863294/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:39:53.688304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d4623-1507-4ef1-8bd6-9bf4d5781072 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:53.688890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d4623-1507-4ef1-8bd6-9bf4d5781072 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:53.689403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d4623-1507-4ef1-8bd6-9bf4d5781072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:53.734114 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dd9d4623-1507-4ef1-8bd6-9bf4d5781072 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:53.735612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dd9d4623-1507-4ef1-8bd6-9bf4d5781072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:53.885341 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1293/2577] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:53.896393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b7981-faca-40dd-b2e4-5cbd73f2452e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:53.899865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2d1b7981-faca-40dd-b2e4-5cbd73f2452e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:53.969366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b7981-faca-40dd-b2e4-5cbd73f2452e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:53.973404 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04bcf7-d1fe-4018-9632-5c4bbaf6b55b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:53.974195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04bcf7-d1fe-4018-9632-5c4bbaf6b55b service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:53.974663 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04bcf7-d1fe-4018-9632-5c4bbaf6b55b service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:53.974971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04bcf7-d1fe-4018-9632-5c4bbaf6b55b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:53.986373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04bcf7-d1fe-4018-9632-5c4bbaf6b55b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:53.987844 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04bcf7-d1fe-4018-9632-5c4bbaf6b55b service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:53.998552 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1285/2578] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:00.177384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b11b-7a7c-4a0c-9bf7-01a643d55dd3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:00.177944 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b11b-7a7c-4a0c-9bf7-01a643d55dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:00.181613 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b11b-7a7c-4a0c-9bf7-01a643d55dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:00.242929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1ef7b11b-7a7c-4a0c-9bf7-01a643d55dd3 None None] MFA Rules not processed for user `0ecdf8d355ca48d68275939352863294`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:00.244063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1ef7b11b-7a7c-4a0c-9bf7-01a643d55dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:00.355426 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1294/2579] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:00.360013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04bcf7-d1fe-4018-9632-5c4bbaf6b55b service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:00.377182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04bcf7-d1fe-4018-9632-5c4bbaf6b55b service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:00.391213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca9a6-3038-41c3-ba6d-cd1962edf1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:00.392988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca9a6-3038-41c3-ba6d-cd1962edf1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:00.393380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca9a6-3038-41c3-ba6d-cd1962edf1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:00.393753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca9a6-3038-41c3-ba6d-cd1962edf1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:00.394510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ca9a6-3038-41c3-ba6d-cd1962edf1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:00.398120 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ca9a6-3038-41c3-ba6d-cd1962edf1e5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:00.443086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1286/2580] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:40:00 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:00.443327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7b11b-7a7c-4a0c-9bf7-01a643d55dd3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:00.456847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7b11b-7a7c-4a0c-9bf7-01a643d55dd3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:00.524209 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6302705-a0a3-439e-8f02-316ed19709c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:00.524732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302705-a0a3-439e-8f02-316ed19709c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:00.525267 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302705-a0a3-439e-8f02-316ed19709c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:00.525536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302705-a0a3-439e-8f02-316ed19709c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:00.526296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6302705-a0a3-439e-8f02-316ed19709c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:00.528309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6302705-a0a3-439e-8f02-316ed19709c3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:00.555542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1295/2581] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:40:00 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:40:00.557155 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca9a6-3038-41c3-ba6d-cd1962edf1e5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:00.568082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca9a6-3038-41c3-ba6d-cd1962edf1e5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:00.573034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347dc4a-eaab-4d44-a241-067d48e1cf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:00.573632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347dc4a-eaab-4d44-a241-067d48e1cf79 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:00.573910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347dc4a-eaab-4d44-a241-067d48e1cf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:00.574181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347dc4a-eaab-4d44-a241-067d48e1cf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:00.574876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347dc4a-eaab-4d44-a241-067d48e1cf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:00.576514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347dc4a-eaab-4d44-a241-067d48e1cf79 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:00.588286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1287/2582] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:00.593069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6302705-a0a3-439e-8f02-316ed19709c3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:00.600575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:00.604629 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6302705-a0a3-439e-8f02-316ed19709c3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:00.611085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458aa16b-68c1-4109-a081-d299d0d0425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:00.611839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458aa16b-68c1-4109-a081-d299d0d0425b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:00.612119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458aa16b-68c1-4109-a081-d299d0d0425b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:00.612388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458aa16b-68c1-4109-a081-d299d0d0425b admin admin] PATH_INFO: `/v3/projects/1f46aa108a524cc29c09ba8c9e7ef228/users/358be4e2f12e46e3b02f357544f04ac0/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:00.628259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458aa16b-68c1-4109-a081-d299d0d0425b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f46aa108a524cc29c09ba8c9e7ef228, user_id=358be4e2f12e46e3b02f357544f04ac0, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:00.630936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458aa16b-68c1-4109-a081-d299d0d0425b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:00.644640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1296/2583] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:00 2022] PUT /identity/v3/projects/1f46aa108a524cc29c09ba8c9e7ef228/users/358be4e2f12e46e3b02f357544f04ac0/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:00.648486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347dc4a-eaab-4d44-a241-067d48e1cf79 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:00.659872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347dc4a-eaab-4d44-a241-067d48e1cf79 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:00.663774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:00.720206 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62921cc4-37f3-4378-9a88-4c2d765c1297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:00.720806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62921cc4-37f3-4378-9a88-4c2d765c1297 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:00.721080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62921cc4-37f3-4378-9a88-4c2d765c1297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:00.721346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62921cc4-37f3-4378-9a88-4c2d765c1297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:00.721982 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62921cc4-37f3-4378-9a88-4c2d765c1297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:00.723600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62921cc4-37f3-4378-9a88-4c2d765c1297 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:00.733871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1288/2584] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:00.737993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458aa16b-68c1-4109-a081-d299d0d0425b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:00.748269 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458aa16b-68c1-4109-a081-d299d0d0425b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:00.752931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b508-178c-49d9-befb-635ce710df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:00.753575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b508-178c-49d9-befb-635ce710df59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:00.753859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b508-178c-49d9-befb-635ce710df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:00.754158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b508-178c-49d9-befb-635ce710df59 admin admin] PATH_INFO: `/v3/projects/1f46aa108a524cc29c09ba8c9e7ef228/users/358be4e2f12e46e3b02f357544f04ac0/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:00.756120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28b508-178c-49d9-befb-635ce710df59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f46aa108a524cc29c09ba8c9e7ef228, user_id=358be4e2f12e46e3b02f357544f04ac0, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:00.758796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28b508-178c-49d9-befb-635ce710df59 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:00.768864 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1297/2585] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:00 2022] PUT /identity/v3/projects/1f46aa108a524cc29c09ba8c9e7ef228/users/358be4e2f12e46e3b02f357544f04ac0/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:03.629678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62921cc4-37f3-4378-9a88-4c2d765c1297 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:03.633030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-62921cc4-37f3-4378-9a88-4c2d765c1297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:03.722582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62921cc4-37f3-4378-9a88-4c2d765c1297 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:03.789886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32bf47-1a72-4c14-9040-c6c3bff3dee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:03.790832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32bf47-1a72-4c14-9040-c6c3bff3dee6 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:03.791285 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32bf47-1a72-4c14-9040-c6c3bff3dee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:03.791714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32bf47-1a72-4c14-9040-c6c3bff3dee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:03.793671 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6b32bf47-1a72-4c14-9040-c6c3bff3dee6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:03.883083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32bf47-1a72-4c14-9040-c6c3bff3dee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:03.884888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32bf47-1a72-4c14-9040-c6c3bff3dee6 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:03.904051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1289/2586] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:05.391567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b508-178c-49d9-befb-635ce710df59 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:05.453492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b508-178c-49d9-befb-635ce710df59 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:05.457834 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dadd3-a067-4e46-b253-0b15f593c1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:05.458494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dadd3-a067-4e46-b253-0b15f593c1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:05.458895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dadd3-a067-4e46-b253-0b15f593c1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:05.459704 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dadd3-a067-4e46-b253-0b15f593c1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:05.461187 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ee5dadd3-a067-4e46-b253-0b15f593c1e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:05.472515 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dadd3-a067-4e46-b253-0b15f593c1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:05.474012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dadd3-a067-4e46-b253-0b15f593c1e7 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:05.490980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1298/2587] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:06.294336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08853fea-678b-40f2-ac20-a4141b9428b1 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:06.295429 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08853fea-678b-40f2-ac20-a4141b9428b1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:06.295541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08853fea-678b-40f2-ac20-a4141b9428b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:06.363945 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-08853fea-678b-40f2-ac20-a4141b9428b1 None None] MFA Rules not processed for user `3a90574a4a3141b1a90f1080c6072b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:06.365427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-08853fea-678b-40f2-ac20-a4141b9428b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:06.379445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:06.472223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1290/2588] 10.222.0.23 () {58 vars in 967 bytes} [Tue Oct 4 08:40:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:06.488100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dadd3-a067-4e46-b253-0b15f593c1e7 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:06.490113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ee5dadd3-a067-4e46-b253-0b15f593c1e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:06.595275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dadd3-a067-4e46-b253-0b15f593c1e7 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:06.602720 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06c16-55d0-4f00-bd31-f160455cd0c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce739a6448604eae823fd285a0164b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:06.603453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06c16-55d0-4f00-bd31-f160455cd0c2 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:06.604304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06c16-55d0-4f00-bd31-f160455cd0c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:06.604732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06c16-55d0-4f00-bd31-f160455cd0c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:06.617730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc06c16-55d0-4f00-bd31-f160455cd0c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:06.619993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc06c16-55d0-4f00-bd31-f160455cd0c2 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:06.634867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1299/2589] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Oct 4 08:40:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:40:08.486590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56138d-7365-4292-97b5-040d1b2a4c89 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:08.487132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56138d-7365-4292-97b5-040d1b2a4c89 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:08.487132 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56138d-7365-4292-97b5-040d1b2a4c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:08.525211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ff56138d-7365-4292-97b5-040d1b2a4c89 None None] MFA Rules not processed for user `358be4e2f12e46e3b02f357544f04ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:08.526535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ff56138d-7365-4292-97b5-040d1b2a4c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:08.613764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1291/2590] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:08.628311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06c16-55d0-4f00-bd31-f160455cd0c2 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:08.630310 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3bc06c16-55d0-4f00-bd31-f160455cd0c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:08.695712 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:08.712725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06c16-55d0-4f00-bd31-f160455cd0c2 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:08.718359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fa447-828e-4383-baa3-234a550924d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:08.719034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fa447-828e-4383-baa3-234a550924d8 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:08.719317 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fa447-828e-4383-baa3-234a550924d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:08.719589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fa447-828e-4383-baa3-234a550924d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:08.779962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fa447-828e-4383-baa3-234a550924d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:08.782962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fa447-828e-4383-baa3-234a550924d8 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:08.792114 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1300/2591] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:09.967370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0cfd3-c232-419f-9a97-418a26d0d3b3 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:09.967920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0cfd3-c232-419f-9a97-418a26d0d3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:09.968047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0cfd3-c232-419f-9a97-418a26d0d3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:09.988833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-41c0cfd3-c232-419f-9a97-418a26d0d3b3 None None] MFA Rules not processed for user `0ecdf8d355ca48d68275939352863294`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:09.990451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-41c0cfd3-c232-419f-9a97-418a26d0d3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:09.997766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1292/2592] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:18.787915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=29 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:19.982925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=56 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:23.235088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fa447-828e-4383-baa3-234a550924d8 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:23.236633 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a04fa447-828e-4383-baa3-234a550924d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:23.250514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fa447-828e-4383-baa3-234a550924d8 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:23.255431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183e03a-22ae-4f76-bc4c-23b10ac14c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:23.256300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183e03a-22ae-4f76-bc4c-23b10ac14c6b service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:23.256580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183e03a-22ae-4f76-bc4c-23b10ac14c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:23.256936 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183e03a-22ae-4f76-bc4c-23b10ac14c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:23.258982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9183e03a-22ae-4f76-bc4c-23b10ac14c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:23.327535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183e03a-22ae-4f76-bc4c-23b10ac14c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:23.329691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183e03a-22ae-4f76-bc4c-23b10ac14c6b service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:23.339436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1301/2593] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:26.502584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0cfd3-c232-419f-9a97-418a26d0d3b3 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:26.504588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-41c0cfd3-c232-419f-9a97-418a26d0d3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:26.521926 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0cfd3-c232-419f-9a97-418a26d0d3b3 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:26.526962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:26.529744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:26.529744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:26.529744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] PATH_INFO: `/v3/users/96219eb4a7d649848ee4e700ae7a65f0` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:26.529744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=96219eb4a7d649848ee4e700ae7a65f0)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:26.531773 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:26.590376 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96219eb4a7d649848ee4e700ae7a65f0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:26.591124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96219eb4a7d649848ee4e700ae7a65f0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:26.604711 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96219eb4a7d649848ee4e700ae7a65f0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:26.612332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96219eb4a7d649848ee4e700ae7a65f0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:26.613054 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9182dfdd-040b-413d-9811-02ad1a69f3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96219eb4a7d649848ee4e700ae7a65f0'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:26.626392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1293/2594] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:40:26 2022] DELETE /identity/v3/users/96219eb4a7d649848ee4e700ae7a65f0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:26.803449 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183e03a-22ae-4f76-bc4c-23b10ac14c6b service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:26.815053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183e03a-22ae-4f76-bc4c-23b10ac14c6b service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:26.874122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:26.874893 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:26.875202 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:26.875697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] PATH_INFO: `/v3/projects/e55e8ca130b948c992c796c3329ad1c8` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:26.876754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e55e8ca130b948c992c796c3329ad1c8)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:26.878876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:26.928113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e55e8ca130b948c992c796c3329ad1c8', 'request_id': 'req-8b6c0676-947f-483e-a608-8743c8500a39'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:26.933417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e55e8ca130b948c992c796c3329ad1c8', 'request_id': 'req-8b6c0676-947f-483e-a608-8743c8500a39'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:26.939523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e55e8ca130b948c992c796c3329ad1c8', 'request_id': 'req-8b6c0676-947f-483e-a608-8743c8500a39'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:26.951812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] The token cache is being invalidate because project e55e8ca130b948c992c796c3329ad1c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:40:26.952164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:26.953031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8b6c0676-947f-483e-a608-8743c8500a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:26.954531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1302/2595] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:40:26 2022] DELETE /identity/v3/projects/e55e8ca130b948c992c796c3329ad1c8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:26.959639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7e031-ef0c-46b5-8931-bec56afee975 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:26.959928 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7e031-ef0c-46b5-8931-bec56afee975 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:26.960198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7e031-ef0c-46b5-8931-bec56afee975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:26.981360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0ce7e031-ef0c-46b5-8931-bec56afee975 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:26.982482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0ce7e031-ef0c-46b5-8931-bec56afee975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:27.039335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1294/2596] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:27.047993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd606b-72bf-44c3-9a2e-88a7eb5ba803 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.048278 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd606b-72bf-44c3-9a2e-88a7eb5ba803 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.048550 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd606b-72bf-44c3-9a2e-88a7eb5ba803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.068136 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c2fd606b-72bf-44c3-9a2e-88a7eb5ba803 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:27.069339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c2fd606b-72bf-44c3-9a2e-88a7eb5ba803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:27.077336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1303/2597] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:27.082382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7e031-ef0c-46b5-8931-bec56afee975 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:27.097148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7e031-ef0c-46b5-8931-bec56afee975 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:27.101851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f21d51-dfe2-44f3-b7a8-c2479a23b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:27.102458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f21d51-dfe2-44f3-b7a8-c2479a23b76f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.102800 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f21d51-dfe2-44f3-b7a8-c2479a23b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.103078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f21d51-dfe2-44f3-b7a8-c2479a23b76f admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.103753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f21d51-dfe2-44f3-b7a8-c2479a23b76f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:40:27.104072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f21d51-dfe2-44f3-b7a8-c2479a23b76f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:27.105652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f21d51-dfe2-44f3-b7a8-c2479a23b76f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:27.117229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1295/2598] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:40:27.121592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd606b-72bf-44c3-9a2e-88a7eb5ba803 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:27.130728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd606b-72bf-44c3-9a2e-88a7eb5ba803 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:27.135397 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935505-4fd4-49e6-aea1-eefb6422ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:27.135987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935505-4fd4-49e6-aea1-eefb6422ab36 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.136268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935505-4fd4-49e6-aea1-eefb6422ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.136539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935505-4fd4-49e6-aea1-eefb6422ab36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.137166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe935505-4fd4-49e6-aea1-eefb6422ab36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:27.139109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe935505-4fd4-49e6-aea1-eefb6422ab36 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:27.155331 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:27.180760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1304/2599] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:40:27 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:40:27.181622 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f21d51-dfe2-44f3-b7a8-c2479a23b76f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:27.193204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f21d51-dfe2-44f3-b7a8-c2479a23b76f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:27.249221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcd9e9-2d44-44d8-b0b1-cbcf11b72c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:27.249775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcd9e9-2d44-44d8-b0b1-cbcf11b72c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.250287 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcd9e9-2d44-44d8-b0b1-cbcf11b72c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.250562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcd9e9-2d44-44d8-b0b1-cbcf11b72c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.251249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcd9e9-2d44-44d8-b0b1-cbcf11b72c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:27.253198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcd9e9-2d44-44d8-b0b1-cbcf11b72c75 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:27.261186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:27.276522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1296/2600] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:40:27 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:40:27.281419 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935505-4fd4-49e6-aea1-eefb6422ab36 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:27.292489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935505-4fd4-49e6-aea1-eefb6422ab36 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:27.297225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48cfbf-af48-4abb-97d3-ca89ac7bda0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:27.297818 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48cfbf-af48-4abb-97d3-ca89ac7bda0b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.298098 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48cfbf-af48-4abb-97d3-ca89ac7bda0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.298387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48cfbf-af48-4abb-97d3-ca89ac7bda0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.299052 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48cfbf-af48-4abb-97d3-ca89ac7bda0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:27.300670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48cfbf-af48-4abb-97d3-ca89ac7bda0b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:27.310428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1305/2601] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:40:27.314792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcd9e9-2d44-44d8-b0b1-cbcf11b72c75 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:27.325000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcd9e9-2d44-44d8-b0b1-cbcf11b72c75 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:27.330211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea013827-7a13-412e-8231-8ef4a3bd954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:27.330856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea013827-7a13-412e-8231-8ef4a3bd954a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.331119 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea013827-7a13-412e-8231-8ef4a3bd954a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.331512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea013827-7a13-412e-8231-8ef4a3bd954a admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.332160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea013827-7a13-412e-8231-8ef4a3bd954a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:27.333740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea013827-7a13-412e-8231-8ef4a3bd954a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:27.344988 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1297/2602] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:27.349171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48cfbf-af48-4abb-97d3-ca89ac7bda0b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:27.359237 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48cfbf-af48-4abb-97d3-ca89ac7bda0b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:27.364116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac8e88-3897-47e1-a4ef-866a1c9f9407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:27.364751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac8e88-3897-47e1-a4ef-866a1c9f9407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.365032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac8e88-3897-47e1-a4ef-866a1c9f9407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.365303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac8e88-3897-47e1-a4ef-866a1c9f9407 admin admin] PATH_INFO: `/v3/projects/6c69bdeae9e94ce3af41acdd0f302798/users/3ead2379269e49b48779f5991419a870/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.380280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac8e88-3897-47e1-a4ef-866a1c9f9407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c69bdeae9e94ce3af41acdd0f302798, user_id=3ead2379269e49b48779f5991419a870, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:27.382797 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac8e88-3897-47e1-a4ef-866a1c9f9407 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:27.395995 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1306/2603] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:27 2022] PUT /identity/v3/projects/6c69bdeae9e94ce3af41acdd0f302798/users/3ead2379269e49b48779f5991419a870/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:27.408524 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b0c55-fa6b-456d-9571-4067663d3377 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.408817 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b0c55-fa6b-456d-9571-4067663d3377 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.409094 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b0c55-fa6b-456d-9571-4067663d3377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.438527 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-400b0c55-fa6b-456d-9571-4067663d3377 None None] MFA Rules not processed for user `3ead2379269e49b48779f5991419a870`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:27.439770 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-400b0c55-fa6b-456d-9571-4067663d3377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:27.505796 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1298/2604] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:27.517527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac8e88-3897-47e1-a4ef-866a1c9f9407 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:27.519240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7dac8e88-3897-47e1-a4ef-866a1c9f9407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:27.594867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac8e88-3897-47e1-a4ef-866a1c9f9407 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:27.600455 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541dcf4-4916-4665-aac3-e86f9265dcb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:27.601075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541dcf4-4916-4665-aac3-e86f9265dcb0 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.601351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541dcf4-4916-4665-aac3-e86f9265dcb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.601626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541dcf4-4916-4665-aac3-e86f9265dcb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.609571 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541dcf4-4916-4665-aac3-e86f9265dcb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:27.611189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541dcf4-4916-4665-aac3-e86f9265dcb0 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:27.619756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1307/2605] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:29.055074 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b0c55-fa6b-456d-9571-4067663d3377 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:29.056566 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-400b0c55-fa6b-456d-9571-4067663d3377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:29.125263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b0c55-fa6b-456d-9571-4067663d3377 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:29.128950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d094cf-9b33-4e28-ae6d-8820896750f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:29.129561 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d094cf-9b33-4e28-ae6d-8820896750f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:29.129841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d094cf-9b33-4e28-ae6d-8820896750f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:29.130114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d094cf-9b33-4e28-ae6d-8820896750f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:29.131841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d2d094cf-9b33-4e28-ae6d-8820896750f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:29.142300 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d094cf-9b33-4e28-ae6d-8820896750f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:29.143787 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d094cf-9b33-4e28-ae6d-8820896750f0 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:29.152220 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1299/2606] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:29.622802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541dcf4-4916-4665-aac3-e86f9265dcb0 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:29.624932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9541dcf4-4916-4665-aac3-e86f9265dcb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:29.700574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541dcf4-4916-4665-aac3-e86f9265dcb0 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:29.705799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a11455-c217-49ac-ae23-cacf74ce9122 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4030325cf0481ab634e253cfed9c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:29.706430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11455-c217-49ac-ae23-cacf74ce9122 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:29.706738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11455-c217-49ac-ae23-cacf74ce9122 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:29.707018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11455-c217-49ac-ae23-cacf74ce9122 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:29.708764 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-55a11455-c217-49ac-ae23-cacf74ce9122 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:29.720516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a11455-c217-49ac-ae23-cacf74ce9122 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:29.722095 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a11455-c217-49ac-ae23-cacf74ce9122 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:29.731861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1308/2607] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:30.335457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d094cf-9b33-4e28-ae6d-8820896750f0 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:30.414383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d094cf-9b33-4e28-ae6d-8820896750f0 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:30.418976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:30.419639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:30.419918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:30.420199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] PATH_INFO: `/v3/users/3ead2379269e49b48779f5991419a870` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:30.422025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ead2379269e49b48779f5991419a870)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:30.423970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:30.437539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:30.476670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ead2379269e49b48779f5991419a870'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:30.477334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ead2379269e49b48779f5991419a870'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:30.490191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ead2379269e49b48779f5991419a870'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:30.497301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ead2379269e49b48779f5991419a870'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:30.497948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ead2379269e49b48779f5991419a870'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:30.510641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1300/2608] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:40:30 2022] DELETE /identity/v3/users/3ead2379269e49b48779f5991419a870 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:30.515709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69686697-3a52-4084-96e0-7c60503f671f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:30.516001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69686697-3a52-4084-96e0-7c60503f671f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:30.516273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69686697-3a52-4084-96e0-7c60503f671f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:30.535916 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-69686697-3a52-4084-96e0-7c60503f671f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:30.537103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69686697-3a52-4084-96e0-7c60503f671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:30.567110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:30.596405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1309/2609] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:30.606174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:30.607761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:30.663872 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f393521-d534-4a2f-8e09-6c8009a53935 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:30.667536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71300f18-bda1-4320-87fc-d523e6821b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:30.668138 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300f18-bda1-4320-87fc-d523e6821b1c service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:30.668413 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300f18-bda1-4320-87fc-d523e6821b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:30.668682 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300f18-bda1-4320-87fc-d523e6821b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:30.678114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71300f18-bda1-4320-87fc-d523e6821b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:30.679575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71300f18-bda1-4320-87fc-d523e6821b1c service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:30.689447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1301/2610] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:31.019386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69686697-3a52-4084-96e0-7c60503f671f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:31.021349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69686697-3a52-4084-96e0-7c60503f671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:31.047690 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69686697-3a52-4084-96e0-7c60503f671f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:31.053665 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:31.054391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.054929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.055273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] PATH_INFO: `/v3/projects/6c69bdeae9e94ce3af41acdd0f302798` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.056417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c69bdeae9e94ce3af41acdd0f302798)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:31.058383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:31.111353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c69bdeae9e94ce3af41acdd0f302798', 'request_id': 'req-ced62028-7f2b-42b9-ba74-25c9a92e951a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:31.117348 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c69bdeae9e94ce3af41acdd0f302798', 'request_id': 'req-ced62028-7f2b-42b9-ba74-25c9a92e951a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:31.124951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c69bdeae9e94ce3af41acdd0f302798', 'request_id': 'req-ced62028-7f2b-42b9-ba74-25c9a92e951a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:31.140759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] The token cache is being invalidate because project 6c69bdeae9e94ce3af41acdd0f302798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:40:31.141051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:31.141718 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ced62028-7f2b-42b9-ba74-25c9a92e951a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:31.143283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1310/2611] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:40:31 2022] DELETE /identity/v3/projects/6c69bdeae9e94ce3af41acdd0f302798 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:31.148715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cf1b5-03ca-4145-94ed-666bd8059e71 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.149477 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cf1b5-03ca-4145-94ed-666bd8059e71 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.149767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cf1b5-03ca-4145-94ed-666bd8059e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.170621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0d7cf1b5-03ca-4145-94ed-666bd8059e71 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:31.171971 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0d7cf1b5-03ca-4145-94ed-666bd8059e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:31.235251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1302/2612] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:31.243076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32656aca-5ac7-4dbf-bb3e-fe355750581d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.243332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32656aca-5ac7-4dbf-bb3e-fe355750581d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.243667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32656aca-5ac7-4dbf-bb3e-fe355750581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.267530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-32656aca-5ac7-4dbf-bb3e-fe355750581d None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:31.268763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-32656aca-5ac7-4dbf-bb3e-fe355750581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:31.277844 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1311/2613] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:31.282966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cf1b5-03ca-4145-94ed-666bd8059e71 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:31.294956 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cf1b5-03ca-4145-94ed-666bd8059e71 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:31.303390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b06b9-2ab1-4353-a078-e4efa8243fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:31.304368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b06b9-2ab1-4353-a078-e4efa8243fff admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.304647 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b06b9-2ab1-4353-a078-e4efa8243fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.304923 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b06b9-2ab1-4353-a078-e4efa8243fff admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.305563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b06b9-2ab1-4353-a078-e4efa8243fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:40:31.305865 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b06b9-2ab1-4353-a078-e4efa8243fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:31.307642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b06b9-2ab1-4353-a078-e4efa8243fff admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:31.326326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1303/2614] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:40:31.327319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32656aca-5ac7-4dbf-bb3e-fe355750581d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:31.338768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32656aca-5ac7-4dbf-bb3e-fe355750581d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:31.344305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d5ab5-f2ae-490b-a02f-17b7fd5f0674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:31.344919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d5ab5-f2ae-490b-a02f-17b7fd5f0674 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.345200 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d5ab5-f2ae-490b-a02f-17b7fd5f0674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.345461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d5ab5-f2ae-490b-a02f-17b7fd5f0674 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.346110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d5ab5-f2ae-490b-a02f-17b7fd5f0674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:31.348034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d5ab5-f2ae-490b-a02f-17b7fd5f0674 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:31.385123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1312/2615] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:40:31 2022] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:31.386507 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b06b9-2ab1-4353-a078-e4efa8243fff admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:31.397517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b06b9-2ab1-4353-a078-e4efa8243fff admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:31.432744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:31.487852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef591df3-2c44-4387-8fbc-98223a3d5859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:31.488464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591df3-2c44-4387-8fbc-98223a3d5859 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.488746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591df3-2c44-4387-8fbc-98223a3d5859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.489021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591df3-2c44-4387-8fbc-98223a3d5859 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.489683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef591df3-2c44-4387-8fbc-98223a3d5859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:31.491652 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef591df3-2c44-4387-8fbc-98223a3d5859 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:31.516198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1304/2616] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:40:31 2022] POST /identity/v3/users => generated 279 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:40:31.517384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d5ab5-f2ae-490b-a02f-17b7fd5f0674 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:31.527966 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d5ab5-f2ae-490b-a02f-17b7fd5f0674 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:31.533580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843603bf-84fa-453b-8c10-1760c0d6ff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:31.534446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843603bf-84fa-453b-8c10-1760c0d6ff0f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.534758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843603bf-84fa-453b-8c10-1760c0d6ff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.535035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843603bf-84fa-453b-8c10-1760c0d6ff0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.535678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843603bf-84fa-453b-8c10-1760c0d6ff0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:31.537300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843603bf-84fa-453b-8c10-1760c0d6ff0f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:31.548601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1313/2617] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:31.552576 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef591df3-2c44-4387-8fbc-98223a3d5859 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:31.564702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef591df3-2c44-4387-8fbc-98223a3d5859 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:31.570876 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8813f-a3af-4618-bd9b-4f8841743a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:31.571530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8813f-a3af-4618-bd9b-4f8841743a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.571899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8813f-a3af-4618-bd9b-4f8841743a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.572218 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8813f-a3af-4618-bd9b-4f8841743a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.572938 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8813f-a3af-4618-bd9b-4f8841743a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:31.574692 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8813f-a3af-4618-bd9b-4f8841743a1f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:31.600042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1305/2618] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:31.600422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843603bf-84fa-453b-8c10-1760c0d6ff0f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:31.610939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843603bf-84fa-453b-8c10-1760c0d6ff0f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:31.615755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902305-2482-4b96-970d-1a5477805027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:31.616435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902305-2482-4b96-970d-1a5477805027 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.616714 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902305-2482-4b96-970d-1a5477805027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.616991 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902305-2482-4b96-970d-1a5477805027 admin admin] PATH_INFO: `/v3/projects/6265842af2ad4fbbbf6f654498c555cb/users/8d49c9ab6e244b32a17bd5fdd40bda7a/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.635805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97902305-2482-4b96-970d-1a5477805027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6265842af2ad4fbbbf6f654498c555cb, user_id=8d49c9ab6e244b32a17bd5fdd40bda7a, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:31.638467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97902305-2482-4b96-970d-1a5477805027 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:31.655538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1314/2619] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:31 2022] PUT /identity/v3/projects/6265842af2ad4fbbbf6f654498c555cb/users/8d49c9ab6e244b32a17bd5fdd40bda7a/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:40:31.666665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d8e2c-fa93-47aa-8a45-2ea921fc6881 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.666977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d8e2c-fa93-47aa-8a45-2ea921fc6881 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.667253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d8e2c-fa93-47aa-8a45-2ea921fc6881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.701517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-0a9d8e2c-fa93-47aa-8a45-2ea921fc6881 None None] MFA Rules not processed for user `8d49c9ab6e244b32a17bd5fdd40bda7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:31.703318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0a9d8e2c-fa93-47aa-8a45-2ea921fc6881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:31.776669 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1306/2620] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:31.781671 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902305-2482-4b96-970d-1a5477805027 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:31.848587 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:31.861313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902305-2482-4b96-970d-1a5477805027 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:31.869325 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51495f04-eae5-446c-a892-b44f7461bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:31.870276 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51495f04-eae5-446c-a892-b44f7461bce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.870561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51495f04-eae5-446c-a892-b44f7461bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.870857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51495f04-eae5-446c-a892-b44f7461bce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.871500 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51495f04-eae5-446c-a892-b44f7461bce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:31.873943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51495f04-eae5-446c-a892-b44f7461bce8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:31.902518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1315/2621] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:40:31 2022] POST /identity/v3/projects => generated 357 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:31.906532 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d8e2c-fa93-47aa-8a45-2ea921fc6881 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:31.917646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d8e2c-fa93-47aa-8a45-2ea921fc6881 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:31.977765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c6700-d2fa-4284-bfd5-4b2a1363a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:31.978378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c6700-d2fa-4284-bfd5-4b2a1363a9ec admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.978656 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c6700-d2fa-4284-bfd5-4b2a1363a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.978967 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c6700-d2fa-4284-bfd5-4b2a1363a9ec admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.979611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c6700-d2fa-4284-bfd5-4b2a1363a9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:31.981523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c6700-d2fa-4284-bfd5-4b2a1363a9ec admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:32.007758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1307/2622] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:40:31 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:40:32.009035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51495f04-eae5-446c-a892-b44f7461bce8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:32.019335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51495f04-eae5-446c-a892-b44f7461bce8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:32.024213 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f638-e83d-4b73-b8d1-e9dcf4f0da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:32.024833 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f638-e83d-4b73-b8d1-e9dcf4f0da6d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:32.025076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f638-e83d-4b73-b8d1-e9dcf4f0da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:32.025340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f638-e83d-4b73-b8d1-e9dcf4f0da6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:32.025977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6f638-e83d-4b73-b8d1-e9dcf4f0da6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:32.027664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6f638-e83d-4b73-b8d1-e9dcf4f0da6d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:32.038696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1316/2623] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:40:32.043123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c6700-d2fa-4284-bfd5-4b2a1363a9ec admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:32.054237 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c6700-d2fa-4284-bfd5-4b2a1363a9ec admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:32.060415 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f27d-e117-434a-8301-5a0cdb8ccb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:32.061141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f27d-e117-434a-8301-5a0cdb8ccb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:32.061418 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f27d-e117-434a-8301-5a0cdb8ccb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:32.062291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f27d-e117-434a-8301-5a0cdb8ccb2a admin admin] PATH_INFO: `/v3/projects/52db2541269a495e84ecb11a8124644f/users/a6afbbdb3a0e49d698346c61d271e272/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:32.098836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30f27d-e117-434a-8301-5a0cdb8ccb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52db2541269a495e84ecb11a8124644f, user_id=a6afbbdb3a0e49d698346c61d271e272, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:32.101495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30f27d-e117-434a-8301-5a0cdb8ccb2a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:32.103974 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:32.117076 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1308/2624] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:32 2022] PUT /identity/v3/projects/52db2541269a495e84ecb11a8124644f/users/a6afbbdb3a0e49d698346c61d271e272/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:32.121482 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f638-e83d-4b73-b8d1-e9dcf4f0da6d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:32.131799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f638-e83d-4b73-b8d1-e9dcf4f0da6d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:32.190937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd29215-7e37-4a12-9ce6-bda4b7f859cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:32.191548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd29215-7e37-4a12-9ce6-bda4b7f859cd admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:32.191826 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd29215-7e37-4a12-9ce6-bda4b7f859cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:32.192096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd29215-7e37-4a12-9ce6-bda4b7f859cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:32.192730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd29215-7e37-4a12-9ce6-bda4b7f859cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:32.194326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd29215-7e37-4a12-9ce6-bda4b7f859cd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:32.204258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1317/2625] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:32.208565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f27d-e117-434a-8301-5a0cdb8ccb2a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:32.219904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f27d-e117-434a-8301-5a0cdb8ccb2a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:32.224685 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4d99-1acf-4686-b4bd-0214e616bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:32.225416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4d99-1acf-4686-b4bd-0214e616bf70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:32.225766 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4d99-1acf-4686-b4bd-0214e616bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:32.226111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4d99-1acf-4686-b4bd-0214e616bf70 admin admin] PATH_INFO: `/v3/projects/52db2541269a495e84ecb11a8124644f/users/a6afbbdb3a0e49d698346c61d271e272/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:32.228162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c4d99-1acf-4686-b4bd-0214e616bf70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52db2541269a495e84ecb11a8124644f, user_id=a6afbbdb3a0e49d698346c61d271e272, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:32.230900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c4d99-1acf-4686-b4bd-0214e616bf70 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:32.242265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1309/2626] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:32 2022] PUT /identity/v3/projects/52db2541269a495e84ecb11a8124644f/users/a6afbbdb3a0e49d698346c61d271e272/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:32.253791 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015214f-d559-441a-8df9-ed5851722aeb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:32.254076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015214f-d559-441a-8df9-ed5851722aeb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:32.254349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015214f-d559-441a-8df9-ed5851722aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:32.283554 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6015214f-d559-441a-8df9-ed5851722aeb None None] MFA Rules not processed for user `a6afbbdb3a0e49d698346c61d271e272`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:32.284768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6015214f-d559-441a-8df9-ed5851722aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:32.361922 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1318/2627] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:32.373459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4d99-1acf-4686-b4bd-0214e616bf70 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:32.375351 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-419c4d99-1acf-4686-b4bd-0214e616bf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:32.433828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015214f-d559-441a-8df9-ed5851722aeb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:32.435785 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6015214f-d559-441a-8df9-ed5851722aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:32.468615 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4d99-1acf-4686-b4bd-0214e616bf70 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:32.473941 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe6fa6-f6f9-469a-bcdd-9256ebc302a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:32.474745 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe6fa6-f6f9-469a-bcdd-9256ebc302a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:32.475047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe6fa6-f6f9-469a-bcdd-9256ebc302a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:32.476468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe6fa6-f6f9-469a-bcdd-9256ebc302a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:32.491026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe6fa6-f6f9-469a-bcdd-9256ebc302a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:32.493179 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe6fa6-f6f9-469a-bcdd-9256ebc302a8 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:32.506577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:32.516499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1310/2628] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:32.544446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015214f-d559-441a-8df9-ed5851722aeb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:32.554411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b8ca8-ffab-4021-a0fd-8a28d5892082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:32.554411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b8ca8-ffab-4021-a0fd-8a28d5892082 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:32.554411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b8ca8-ffab-4021-a0fd-8a28d5892082 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:32.554411 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b8ca8-ffab-4021-a0fd-8a28d5892082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:32.555031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c61b8ca8-ffab-4021-a0fd-8a28d5892082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:32.567490 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b8ca8-ffab-4021-a0fd-8a28d5892082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:32.569162 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b8ca8-ffab-4021-a0fd-8a28d5892082 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:32.582574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1319/2629] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:32.606859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe6fa6-f6f9-469a-bcdd-9256ebc302a8 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:32.616665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe6fa6-f6f9-469a-bcdd-9256ebc302a8 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:32.620748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e87a-351a-4da5-bd47-c9080f767d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:32.621406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e87a-351a-4da5-bd47-c9080f767d3b service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:32.621687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e87a-351a-4da5-bd47-c9080f767d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:32.621959 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e87a-351a-4da5-bd47-c9080f767d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:32.685241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391e87a-351a-4da5-bd47-c9080f767d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:32.686835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391e87a-351a-4da5-bd47-c9080f767d3b service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:32.696842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1311/2630] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:35.724433 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c098-1b00-44f6-92bc-8e170939a95e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:35.724982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c098-1b00-44f6-92bc-8e170939a95e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:35.724982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c098-1b00-44f6-92bc-8e170939a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:35.745094 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7eb2c098-1b00-44f6-92bc-8e170939a95e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:35.746320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7eb2c098-1b00-44f6-92bc-8e170939a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:35.805272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1320/2631] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:35.833731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e87a-351a-4da5-bd47-c9080f767d3b service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:35.835070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d391e87a-351a-4da5-bd47-c9080f767d3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:35.851370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e87a-351a-4da5-bd47-c9080f767d3b service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:35.856777 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafc8cc-6b14-45f9-a7aa-ca575c0cd89a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:35.857366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc8cc-6b14-45f9-a7aa-ca575c0cd89a service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:35.857643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc8cc-6b14-45f9-a7aa-ca575c0cd89a service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:35.857909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc8cc-6b14-45f9-a7aa-ca575c0cd89a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:35.866930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafc8cc-6b14-45f9-a7aa-ca575c0cd89a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:35.868538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafc8cc-6b14-45f9-a7aa-ca575c0cd89a service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:35.879890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1312/2632] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:36.522318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c098-1b00-44f6-92bc-8e170939a95e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:36.540813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c098-1b00-44f6-92bc-8e170939a95e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:36.546779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b09747-2a43-4e5f-a469-c4cea2b95bfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:36.547755 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b09747-2a43-4e5f-a469-c4cea2b95bfe service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:36.548167 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b09747-2a43-4e5f-a469-c4cea2b95bfe service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:36.548519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b09747-2a43-4e5f-a469-c4cea2b95bfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:36.550970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f6b09747-2a43-4e5f-a469-c4cea2b95bfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:36.567941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b09747-2a43-4e5f-a469-c4cea2b95bfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:36.567941 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b09747-2a43-4e5f-a469-c4cea2b95bfe service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:36.582408 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1321/2633] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:38.754939 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc063248-a9c5-494b-bddf-89f27cfbc73a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:38.755503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc063248-a9c5-494b-bddf-89f27cfbc73a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:38.755503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc063248-a9c5-494b-bddf-89f27cfbc73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:38.775501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-cc063248-a9c5-494b-bddf-89f27cfbc73a None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:38.776695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cc063248-a9c5-494b-bddf-89f27cfbc73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:38.784515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1313/2634] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:38.799335 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b09747-2a43-4e5f-a469-c4cea2b95bfe service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:38.810191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b09747-2a43-4e5f-a469-c4cea2b95bfe service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:38.816305 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e86dbd-e057-4d80-9480-ca44c5dff6c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:38.816887 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e86dbd-e057-4d80-9480-ca44c5dff6c4 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:38.817164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e86dbd-e057-4d80-9480-ca44c5dff6c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:38.817434 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e86dbd-e057-4d80-9480-ca44c5dff6c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:38.825340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e86dbd-e057-4d80-9480-ca44c5dff6c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:38.826946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e86dbd-e057-4d80-9480-ca44c5dff6c4 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:38.836933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1322/2635] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:39.375955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc063248-a9c5-494b-bddf-89f27cfbc73a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:39.378183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cc063248-a9c5-494b-bddf-89f27cfbc73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:39.435232 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc063248-a9c5-494b-bddf-89f27cfbc73a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:39.438805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74474cd2-57aa-437a-ac7c-3e30f2948907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:39.439459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74474cd2-57aa-437a-ac7c-3e30f2948907 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:39.439753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74474cd2-57aa-437a-ac7c-3e30f2948907 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:39.439987 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74474cd2-57aa-437a-ac7c-3e30f2948907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:39.441779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-74474cd2-57aa-437a-ac7c-3e30f2948907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:39.463759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:39.516653 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74474cd2-57aa-437a-ac7c-3e30f2948907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:39.518193 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74474cd2-57aa-437a-ac7c-3e30f2948907 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:39.528336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1314/2636] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:41.353171 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e86dbd-e057-4d80-9480-ca44c5dff6c4 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:41.365256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e86dbd-e057-4d80-9480-ca44c5dff6c4 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:41.371197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22a136-32a2-4bbf-afc5-6bb41f739b33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:41.371796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a136-32a2-4bbf-afc5-6bb41f739b33 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:41.372336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a136-32a2-4bbf-afc5-6bb41f739b33 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:41.372614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a136-32a2-4bbf-afc5-6bb41f739b33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:41.374371 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fc22a136-32a2-4bbf-afc5-6bb41f739b33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:41.387984 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22a136-32a2-4bbf-afc5-6bb41f739b33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:41.389334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22a136-32a2-4bbf-afc5-6bb41f739b33 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:41.400437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1323/2637] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:42.043772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46dcca-7d98-414d-aa23-f79cf440b6ec None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:42.044723 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46dcca-7d98-414d-aa23-f79cf440b6ec None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:42.045152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46dcca-7d98-414d-aa23-f79cf440b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:42.067599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-4a46dcca-7d98-414d-aa23-f79cf440b6ec None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:42.068756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4a46dcca-7d98-414d-aa23-f79cf440b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:42.077688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1315/2638] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:42.093244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22a136-32a2-4bbf-afc5-6bb41f739b33 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:42.106156 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22a136-32a2-4bbf-afc5-6bb41f739b33 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:42.112534 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9214a-0117-4d18-bda0-1d17fed7e5cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:42.113364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9214a-0117-4d18-bda0-1d17fed7e5cb service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:42.113804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9214a-0117-4d18-bda0-1d17fed7e5cb service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:42.114292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9214a-0117-4d18-bda0-1d17fed7e5cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:42.125398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9214a-0117-4d18-bda0-1d17fed7e5cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:42.129105 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9214a-0117-4d18-bda0-1d17fed7e5cb service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:42.140969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1324/2639] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:45.155026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc84d-3c9f-47cc-86f0-872775155f90 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:45.155516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc84d-3c9f-47cc-86f0-872775155f90 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:45.155616 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc84d-3c9f-47cc-86f0-872775155f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:45.177616 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-b66bc84d-3c9f-47cc-86f0-872775155f90 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:45.178878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-b66bc84d-3c9f-47cc-86f0-872775155f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:45.187383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1316/2640] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:45.204371 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9214a-0117-4d18-bda0-1d17fed7e5cb service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:45.215564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9214a-0117-4d18-bda0-1d17fed7e5cb service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:45.221016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b1252-8f71-4cf3-8899-722b995be414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:45.221605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b1252-8f71-4cf3-8899-722b995be414 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:45.221884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b1252-8f71-4cf3-8899-722b995be414 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:45.222155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b1252-8f71-4cf3-8899-722b995be414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:45.229943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b1252-8f71-4cf3-8899-722b995be414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:45.231538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b1252-8f71-4cf3-8899-722b995be414 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:45.241164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1325/2641] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:47.791009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bc84d-3c9f-47cc-86f0-872775155f90 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:47.800794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bc84d-3c9f-47cc-86f0-872775155f90 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:47.805322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:47.805930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:47.806209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:47.806482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] PATH_INFO: `/v3/users/8d49c9ab6e244b32a17bd5fdd40bda7a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:47.807642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d49c9ab6e244b32a17bd5fdd40bda7a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:47.809562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:47.860250 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d49c9ab6e244b32a17bd5fdd40bda7a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:47.860930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d49c9ab6e244b32a17bd5fdd40bda7a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:47.872885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d49c9ab6e244b32a17bd5fdd40bda7a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:47.880491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d49c9ab6e244b32a17bd5fdd40bda7a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:47.881167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d49c9ab6e244b32a17bd5fdd40bda7a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:47.894114 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1317/2642] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:40:47 2022] DELETE /identity/v3/users/8d49c9ab6e244b32a17bd5fdd40bda7a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:40:47.898878 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa36152-fa9b-4297-a824-9414b0ff6032 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:47.899334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa36152-fa9b-4297-a824-9414b0ff6032 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:47.899454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa36152-fa9b-4297-a824-9414b0ff6032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:47.917812 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3fa36152-fa9b-4297-a824-9414b0ff6032 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:47.919153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3fa36152-fa9b-4297-a824-9414b0ff6032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:47.977164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1326/2643] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:47.987051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:47.988482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:48.044898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfe430-74ca-4de0-9e2f-d531e2d14f1a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:48.049160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bae51-8a2b-41fb-8b68-d4ed184f93ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:48.049759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bae51-8a2b-41fb-8b68-d4ed184f93ef service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:48.050038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bae51-8a2b-41fb-8b68-d4ed184f93ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:48.050310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bae51-8a2b-41fb-8b68-d4ed184f93ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:48.059307 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bae51-8a2b-41fb-8b68-d4ed184f93ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:48.060737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bae51-8a2b-41fb-8b68-d4ed184f93ef service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:48.070661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1318/2644] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:48.303849 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6095fcc-b68d-438a-89d9-60c05c1f17fd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:48.304140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6095fcc-b68d-438a-89d9-60c05c1f17fd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:48.304440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6095fcc-b68d-438a-89d9-60c05c1f17fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:48.324811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a6095fcc-b68d-438a-89d9-60c05c1f17fd None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:48.326020 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6095fcc-b68d-438a-89d9-60c05c1f17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:48.335373 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1327/2645] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:48.347448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bae51-8a2b-41fb-8b68-d4ed184f93ef service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:48.348851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-be3bae51-8a2b-41fb-8b68-d4ed184f93ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:48.362909 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bae51-8a2b-41fb-8b68-d4ed184f93ef service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:48.367703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:48.368455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:48.368736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:48.370336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6095fcc-b68d-438a-89d9-60c05c1f17fd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:48.372001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6095fcc-b68d-438a-89d9-60c05c1f17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:48.372495 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] PATH_INFO: `/v3/projects/6265842af2ad4fbbbf6f654498c555cb` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:48.373654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6265842af2ad4fbbbf6f654498c555cb)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:48.375613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:48.380285 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:48.385423 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:48.428727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6265842af2ad4fbbbf6f654498c555cb', 'request_id': 'req-f82a26c7-ab4d-4146-9f67-42151076b0e6'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:48.434968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6265842af2ad4fbbbf6f654498c555cb', 'request_id': 'req-f82a26c7-ab4d-4146-9f67-42151076b0e6'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:48.441092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6265842af2ad4fbbbf6f654498c555cb', 'request_id': 'req-f82a26c7-ab4d-4146-9f67-42151076b0e6'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:48.455203 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6095fcc-b68d-438a-89d9-60c05c1f17fd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:48.458798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] The token cache is being invalidate because project 6265842af2ad4fbbbf6f654498c555cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:40:48.459091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:48.459756 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:48.461715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1319/2646] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:40:48 2022] DELETE /identity/v3/projects/6265842af2ad4fbbbf6f654498c555cb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:48.471158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:48.472903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:48.519612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f3280-8be3-4617-b3d2-ccba942b4d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:48.520147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f3280-8be3-4617-b3d2-ccba942b4d15 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:48.520430 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f3280-8be3-4617-b3d2-ccba942b4d15 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:48.520705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f3280-8be3-4617-b3d2-ccba942b4d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:48.522440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a70f3280-8be3-4617-b3d2-ccba942b4d15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:48.538936 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a26c7-ab4d-4146-9f67-42151076b0e6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:48.543897 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:48.544536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:48.544940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:48.545240 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] PATH_INFO: `/v3/users/a6afbbdb3a0e49d698346c61d271e272` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:48.546366 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6afbbdb3a0e49d698346c61d271e272)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:48.548500 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:48.584650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f3280-8be3-4617-b3d2-ccba942b4d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:48.586231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f3280-8be3-4617-b3d2-ccba942b4d15 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:48.595629 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1328/2647] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:40:48.598587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6afbbdb3a0e49d698346c61d271e272'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:48.599352 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6afbbdb3a0e49d698346c61d271e272'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:48.612409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6afbbdb3a0e49d698346c61d271e272'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:48.619303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6afbbdb3a0e49d698346c61d271e272'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:48.620027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-704879ec-5bac-4058-86ff-62e58454f570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6afbbdb3a0e49d698346c61d271e272'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:48.634184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1320/2648] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:40:48 2022] DELETE /identity/v3/users/a6afbbdb3a0e49d698346c61d271e272 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:40:48.896059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f3280-8be3-4617-b3d2-ccba942b4d15 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:48.906030 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f3280-8be3-4617-b3d2-ccba942b4d15 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:48.940654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:48.965166 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:48.965798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:48.966078 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:48.966351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] PATH_INFO: `/v3/projects/52db2541269a495e84ecb11a8124644f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:48.967485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52db2541269a495e84ecb11a8124644f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:48.969382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.014041 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52db2541269a495e84ecb11a8124644f', 'request_id': 'req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:49.020448 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52db2541269a495e84ecb11a8124644f', 'request_id': 'req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:49.026719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52db2541269a495e84ecb11a8124644f', 'request_id': 'req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:49.039854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] The token cache is being invalidate because project 52db2541269a495e84ecb11a8124644f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:40:49.040146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:49.040769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc1d2e9f-44d3-4fbd-b4bf-406533c0e073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:49.042229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1329/2649] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:40:48 2022] DELETE /identity/v3/projects/52db2541269a495e84ecb11a8124644f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:49.047265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2fbb9-2464-4186-a8e5-a0f502d7e0cb None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.047715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2fbb9-2464-4186-a8e5-a0f502d7e0cb None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.047829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2fbb9-2464-4186-a8e5-a0f502d7e0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.068198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-d8d2fbb9-2464-4186-a8e5-a0f502d7e0cb None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:49.069407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d8d2fbb9-2464-4186-a8e5-a0f502d7e0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:49.078862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:49.131265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1321/2650] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:49.139284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a27f-c324-4dc9-824d-760a3f6e2dea None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.139568 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a27f-c324-4dc9-824d-760a3f6e2dea None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.139841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a27f-c324-4dc9-824d-760a3f6e2dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.159827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a9a6a27f-c324-4dc9-824d-760a3f6e2dea None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:49.161055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a9a6a27f-c324-4dc9-824d-760a3f6e2dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:49.168873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1330/2651] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:49.173160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2fbb9-2464-4186-a8e5-a0f502d7e0cb None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.182590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2fbb9-2464-4186-a8e5-a0f502d7e0cb None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.187086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679445f8-05e4-4a3a-b72a-3c62b35ebf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.187678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679445f8-05e4-4a3a-b72a-3c62b35ebf1d admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.187950 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679445f8-05e4-4a3a-b72a-3c62b35ebf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.188260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679445f8-05e4-4a3a-b72a-3c62b35ebf1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.189374 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679445f8-05e4-4a3a-b72a-3c62b35ebf1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:40:49.189672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679445f8-05e4-4a3a-b72a-3c62b35ebf1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.191279 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679445f8-05e4-4a3a-b72a-3c62b35ebf1d admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.202375 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1322/2652] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:40:49.207196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6a27f-c324-4dc9-824d-760a3f6e2dea None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.216277 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6a27f-c324-4dc9-824d-760a3f6e2dea None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.220895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355b2d8-ca2d-4a63-aefa-b9b530cea353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.221486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355b2d8-ca2d-4a63-aefa-b9b530cea353 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.221761 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355b2d8-ca2d-4a63-aefa-b9b530cea353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.222034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355b2d8-ca2d-4a63-aefa-b9b530cea353 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.222654 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355b2d8-ca2d-4a63-aefa-b9b530cea353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.224565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355b2d8-ca2d-4a63-aefa-b9b530cea353 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.251707 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1331/2653] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:40:49 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:49.255836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679445f8-05e4-4a3a-b72a-3c62b35ebf1d admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.265670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679445f8-05e4-4a3a-b72a-3c62b35ebf1d admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.323422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0c669-174c-4956-a1c0-f7d1ca9cc2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.326832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0c669-174c-4956-a1c0-f7d1ca9cc2cb admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.327151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0c669-174c-4956-a1c0-f7d1ca9cc2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.327434 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0c669-174c-4956-a1c0-f7d1ca9cc2cb admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.328098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0c669-174c-4956-a1c0-f7d1ca9cc2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.330736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0c669-174c-4956-a1c0-f7d1ca9cc2cb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.350751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1323/2654] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:40:49 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:49.354952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355b2d8-ca2d-4a63-aefa-b9b530cea353 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.365135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355b2d8-ca2d-4a63-aefa-b9b530cea353 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.369662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fc7ef-6f42-41f1-acca-658d98d3f4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.370254 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc7ef-6f42-41f1-acca-658d98d3f4cb admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.370531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc7ef-6f42-41f1-acca-658d98d3f4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.370839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc7ef-6f42-41f1-acca-658d98d3f4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.371471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fc7ef-6f42-41f1-acca-658d98d3f4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.373049 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fc7ef-6f42-41f1-acca-658d98d3f4cb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.383306 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1332/2655] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:49.387251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0c669-174c-4956-a1c0-f7d1ca9cc2cb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.398022 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0c669-174c-4956-a1c0-f7d1ca9cc2cb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.402960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64912968-054a-4d05-b31d-1767eb5bfe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.403553 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64912968-054a-4d05-b31d-1767eb5bfe92 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.403835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64912968-054a-4d05-b31d-1767eb5bfe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.404112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64912968-054a-4d05-b31d-1767eb5bfe92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.404753 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64912968-054a-4d05-b31d-1767eb5bfe92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.406340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64912968-054a-4d05-b31d-1767eb5bfe92 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.416830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1324/2656] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:49.420838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fc7ef-6f42-41f1-acca-658d98d3f4cb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.430873 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fc7ef-6f42-41f1-acca-658d98d3f4cb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.435486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae422ec5-348d-4bfb-a4cf-1a68089cbf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.436119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422ec5-348d-4bfb-a4cf-1a68089cbf7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.436401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422ec5-348d-4bfb-a4cf-1a68089cbf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.436670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422ec5-348d-4bfb-a4cf-1a68089cbf7c admin admin] PATH_INFO: `/v3/projects/a8c66fa9a16f4a1fa02d0122e0037a48/users/470cc228a8a449c48c2f55e234b27976/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.451647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae422ec5-348d-4bfb-a4cf-1a68089cbf7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c66fa9a16f4a1fa02d0122e0037a48, user_id=470cc228a8a449c48c2f55e234b27976, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.455018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae422ec5-348d-4bfb-a4cf-1a68089cbf7c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.468403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1333/2657] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:49 2022] PUT /identity/v3/projects/a8c66fa9a16f4a1fa02d0122e0037a48/users/470cc228a8a449c48c2f55e234b27976/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:49.478617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2017-01a9-4368-ad3c-69bc001642f8 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.478937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2017-01a9-4368-ad3c-69bc001642f8 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.479211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2017-01a9-4368-ad3c-69bc001642f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.507541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-497e2017-01a9-4368-ad3c-69bc001642f8 None None] MFA Rules not processed for user `470cc228a8a449c48c2f55e234b27976`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:49.508741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-497e2017-01a9-4368-ad3c-69bc001642f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:49.577818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1325/2658] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:49.583005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae422ec5-348d-4bfb-a4cf-1a68089cbf7c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.649153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae422ec5-348d-4bfb-a4cf-1a68089cbf7c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.654023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4fc01-15d2-4daa-8ad3-2ad1bb18d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.654631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4fc01-15d2-4daa-8ad3-2ad1bb18d4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.654942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4fc01-15d2-4daa-8ad3-2ad1bb18d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.655216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4fc01-15d2-4daa-8ad3-2ad1bb18d4c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.655889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4fc01-15d2-4daa-8ad3-2ad1bb18d4c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.658312 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4fc01-15d2-4daa-8ad3-2ad1bb18d4c9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.663892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:49.689854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1334/2659] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:40:49 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:49.694055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2017-01a9-4368-ad3c-69bc001642f8 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.705638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2017-01a9-4368-ad3c-69bc001642f8 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.713595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:49.770918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359acba-5a2f-467a-b2a6-d34095fa77f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.771534 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359acba-5a2f-467a-b2a6-d34095fa77f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.771814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359acba-5a2f-467a-b2a6-d34095fa77f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.772088 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359acba-5a2f-467a-b2a6-d34095fa77f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.772718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359acba-5a2f-467a-b2a6-d34095fa77f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.774903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359acba-5a2f-467a-b2a6-d34095fa77f1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.797588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1326/2660] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:40:49 2022] POST /identity/v3/users => generated 306 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:49.802302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4fc01-15d2-4daa-8ad3-2ad1bb18d4c9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.812810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4fc01-15d2-4daa-8ad3-2ad1bb18d4c9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.818622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7eb4e-61f0-4935-8088-28d0557dd4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.819248 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7eb4e-61f0-4935-8088-28d0557dd4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.819525 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7eb4e-61f0-4935-8088-28d0557dd4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.819796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7eb4e-61f0-4935-8088-28d0557dd4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.820432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7eb4e-61f0-4935-8088-28d0557dd4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.822019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7eb4e-61f0-4935-8088-28d0557dd4d2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.832709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1335/2661] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:49.837125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359acba-5a2f-467a-b2a6-d34095fa77f1 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.847704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359acba-5a2f-467a-b2a6-d34095fa77f1 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.852645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02a273-0490-4c52-b144-ef2b7706618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.853304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02a273-0490-4c52-b144-ef2b7706618a admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.853581 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02a273-0490-4c52-b144-ef2b7706618a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.853852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02a273-0490-4c52-b144-ef2b7706618a admin admin] PATH_INFO: `/v3/projects/f773c88030014bafa216f34f79db9ccd/users/022b1453e0f446c3bf414541df2d4e39/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.871898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02a273-0490-4c52-b144-ef2b7706618a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f773c88030014bafa216f34f79db9ccd, user_id=022b1453e0f446c3bf414541df2d4e39, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.874572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02a273-0490-4c52-b144-ef2b7706618a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.888530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1327/2662] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:49 2022] PUT /identity/v3/projects/f773c88030014bafa216f34f79db9ccd/users/022b1453e0f446c3bf414541df2d4e39/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:49.892440 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7eb4e-61f0-4935-8088-28d0557dd4d2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.902783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7eb4e-61f0-4935-8088-28d0557dd4d2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.965376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c75714-228e-4b9f-949c-8009b961c5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:49.966068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c75714-228e-4b9f-949c-8009b961c5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:49.966401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c75714-228e-4b9f-949c-8009b961c5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:49.966655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c75714-228e-4b9f-949c-8009b961c5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:49.967321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c75714-228e-4b9f-949c-8009b961c5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:49.968924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c75714-228e-4b9f-949c-8009b961c5d8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:49.980598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1336/2663] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:49.984838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02a273-0490-4c52-b144-ef2b7706618a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:49.995304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02a273-0490-4c52-b144-ef2b7706618a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:49.999989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fc6f8-c2f0-4c52-a7da-a869e819ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:50.000641 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fc6f8-c2f0-4c52-a7da-a869e819ffeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:50.001419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fc6f8-c2f0-4c52-a7da-a869e819ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:50.001738 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fc6f8-c2f0-4c52-a7da-a869e819ffeb admin admin] PATH_INFO: `/v3/projects/f773c88030014bafa216f34f79db9ccd/users/022b1453e0f446c3bf414541df2d4e39/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:50.003646 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fc6f8-c2f0-4c52-a7da-a869e819ffeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f773c88030014bafa216f34f79db9ccd, user_id=022b1453e0f446c3bf414541df2d4e39, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:50.014017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fc6f8-c2f0-4c52-a7da-a869e819ffeb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:50.034264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1328/2664] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:49 2022] PUT /identity/v3/projects/f773c88030014bafa216f34f79db9ccd/users/022b1453e0f446c3bf414541df2d4e39/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:50.045544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf139f-a421-4b88-909b-e5bf8a600570 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:50.045832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf139f-a421-4b88-909b-e5bf8a600570 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:50.046112 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf139f-a421-4b88-909b-e5bf8a600570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:50.073980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-37cf139f-a421-4b88-909b-e5bf8a600570 None None] MFA Rules not processed for user `022b1453e0f446c3bf414541df2d4e39`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:50.075226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-37cf139f-a421-4b88-909b-e5bf8a600570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:50.141233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1337/2665] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:50.152445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fc6f8-c2f0-4c52-a7da-a869e819ffeb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:50.154151 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4f4fc6f8-c2f0-4c52-a7da-a869e819ffeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:50.214044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fc6f8-c2f0-4c52-a7da-a869e819ffeb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:50.217908 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330b644-1a2a-42e5-8ab8-6e3087e7a430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:50.218515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330b644-1a2a-42e5-8ab8-6e3087e7a430 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:50.218828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330b644-1a2a-42e5-8ab8-6e3087e7a430 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:50.219102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330b644-1a2a-42e5-8ab8-6e3087e7a430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:50.228626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330b644-1a2a-42e5-8ab8-6e3087e7a430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:50.230057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330b644-1a2a-42e5-8ab8-6e3087e7a430 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:50.240130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1329/2666] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:50.315117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf139f-a421-4b88-909b-e5bf8a600570 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:50.324727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf139f-a421-4b88-909b-e5bf8a600570 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:50.328488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74d599-f634-4099-88d0-678bb406c62a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:50.329662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74d599-f634-4099-88d0-678bb406c62a service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:50.329970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74d599-f634-4099-88d0-678bb406c62a service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:50.330387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74d599-f634-4099-88d0-678bb406c62a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:50.386381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:50.388970 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74d599-f634-4099-88d0-678bb406c62a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:50.390973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74d599-f634-4099-88d0-678bb406c62a service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:50.401943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1338/2667] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:52.530940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2880c-ce80-4337-b51a-71b1d20cf556 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:52.531447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2880c-ce80-4337-b51a-71b1d20cf556 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:52.534192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2880c-ce80-4337-b51a-71b1d20cf556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:52.573173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-40f2880c-ce80-4337-b51a-71b1d20cf556 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:52.574878 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-40f2880c-ce80-4337-b51a-71b1d20cf556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:52.654260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1330/2668] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:52.671098 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74d599-f634-4099-88d0-678bb406c62a service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:52.673951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4d74d599-f634-4099-88d0-678bb406c62a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:52.775868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74d599-f634-4099-88d0-678bb406c62a service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:52.781903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a66f8a-3cf5-49cf-894e-f2f7770a021a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:52.782691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66f8a-3cf5-49cf-894e-f2f7770a021a service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:52.783044 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66f8a-3cf5-49cf-894e-f2f7770a021a service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:52.783381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66f8a-3cf5-49cf-894e-f2f7770a021a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:52.792076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a66f8a-3cf5-49cf-894e-f2f7770a021a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:52.793834 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a66f8a-3cf5-49cf-894e-f2f7770a021a service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:52.805367 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1339/2669] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:54.565321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2880c-ce80-4337-b51a-71b1d20cf556 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:54.581348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2880c-ce80-4337-b51a-71b1d20cf556 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:54.586209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:54.586814 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:54.587092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:54.587383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] PATH_INFO: `/v3/users/470cc228a8a449c48c2f55e234b27976` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:54.588510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=470cc228a8a449c48c2f55e234b27976)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:54.590398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:54.592211 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:54.644318 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470cc228a8a449c48c2f55e234b27976'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:54.644965 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470cc228a8a449c48c2f55e234b27976'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:54.658199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470cc228a8a449c48c2f55e234b27976'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:54.665635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470cc228a8a449c48c2f55e234b27976'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:54.666334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470cc228a8a449c48c2f55e234b27976'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:54.681152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1331/2670] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:40:54 2022] DELETE /identity/v3/users/470cc228a8a449c48c2f55e234b27976 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:54.685589 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3d2d-af6d-45d9-a763-c8b772edaa7c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:54.686069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3d2d-af6d-45d9-a763-c8b772edaa7c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:54.686169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3d2d-af6d-45d9-a763-c8b772edaa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:54.706943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-21ec3d2d-af6d-45d9-a763-c8b772edaa7c None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:54.708158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-21ec3d2d-af6d-45d9-a763-c8b772edaa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:54.773980 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1340/2671] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:40:54.787744 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:54.790117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:54.849716 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e9acd-fa36-41aa-b312-a7620cae05b3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:54.853388 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1616aa-6742-4a36-986a-8e082d6d63bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:54.854055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1616aa-6742-4a36-986a-8e082d6d63bb service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:54.854347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1616aa-6742-4a36-986a-8e082d6d63bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:54.854619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1616aa-6742-4a36-986a-8e082d6d63bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:54.865174 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1616aa-6742-4a36-986a-8e082d6d63bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:54.866859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1616aa-6742-4a36-986a-8e082d6d63bb service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:54.877254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1332/2672] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:40:55.175378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3d2d-af6d-45d9-a763-c8b772edaa7c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:55.177208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-21ec3d2d-af6d-45d9-a763-c8b772edaa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:55.213201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3d2d-af6d-45d9-a763-c8b772edaa7c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:55.218467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:55.219135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:55.219951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:55.220241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] PATH_INFO: `/v3/projects/a8c66fa9a16f4a1fa02d0122e0037a48` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:55.221366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c66fa9a16f4a1fa02d0122e0037a48)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:55.223318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:55.277048 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c66fa9a16f4a1fa02d0122e0037a48', 'request_id': 'req-867b0f8a-9ca0-4c08-bac5-df3c587207e6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.283480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c66fa9a16f4a1fa02d0122e0037a48', 'request_id': 'req-867b0f8a-9ca0-4c08-bac5-df3c587207e6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.290465 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c66fa9a16f4a1fa02d0122e0037a48', 'request_id': 'req-867b0f8a-9ca0-4c08-bac5-df3c587207e6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.305487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] The token cache is being invalidate because project a8c66fa9a16f4a1fa02d0122e0037a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:40:55.305908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.307065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.309070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1341/2673] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:40:55 2022] DELETE /identity/v3/projects/a8c66fa9a16f4a1fa02d0122e0037a48 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:55.312794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1616aa-6742-4a36-986a-8e082d6d63bb service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:55.323531 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1616aa-6742-4a36-986a-8e082d6d63bb service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:55.382946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:55.383517 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:55.383794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:55.384062 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] PATH_INFO: `/v3/users/022b1453e0f446c3bf414541df2d4e39` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:55.385167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=022b1453e0f446c3bf414541df2d4e39)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:55.387096 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:55.410126 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:55.436196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022b1453e0f446c3bf414541df2d4e39'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.436847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022b1453e0f446c3bf414541df2d4e39'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.450172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022b1453e0f446c3bf414541df2d4e39'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.458270 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022b1453e0f446c3bf414541df2d4e39'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.459007 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-676ce698-6dae-4070-9ecc-cffa9dd27d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022b1453e0f446c3bf414541df2d4e39'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.475329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1333/2674] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:40:55 2022] DELETE /identity/v3/users/022b1453e0f446c3bf414541df2d4e39 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:55.756781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:55.758880 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:55.775395 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:55.780378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b0f8a-9ca0-4c08-bac5-df3c587207e6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:55.851976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:55.852684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:55.853031 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:55.853193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] PATH_INFO: `/v3/projects/f773c88030014bafa216f34f79db9ccd` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:55.854548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f773c88030014bafa216f34f79db9ccd)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:55.856488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:55.909676 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f773c88030014bafa216f34f79db9ccd', 'request_id': 'req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.915284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f773c88030014bafa216f34f79db9ccd', 'request_id': 'req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.921436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f773c88030014bafa216f34f79db9ccd', 'request_id': 'req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.934473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] The token cache is being invalidate because project f773c88030014bafa216f34f79db9ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:40:55.934800 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.935429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b6c6cbf6-4295-4d84-b6ee-b1b91f12365f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:40:55.936952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1342/2675] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:40:55 2022] DELETE /identity/v3/projects/f773c88030014bafa216f34f79db9ccd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:55.941951 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2da48-34cb-46f5-ae2a-e6aa46614419 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:55.942410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2da48-34cb-46f5-ae2a-e6aa46614419 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:55.942505 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2da48-34cb-46f5-ae2a-e6aa46614419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:55.961924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8da2da48-34cb-46f5-ae2a-e6aa46614419 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:55.963160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8da2da48-34cb-46f5-ae2a-e6aa46614419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:56.022022 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1334/2676] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:56.030104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ca3ba-fc43-4225-a598-a7c0f68758a7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.030391 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ca3ba-fc43-4225-a598-a7c0f68758a7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.030669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ca3ba-fc43-4225-a598-a7c0f68758a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.051380 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e12ca3ba-fc43-4225-a598-a7c0f68758a7 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:56.052602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e12ca3ba-fc43-4225-a598-a7c0f68758a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:56.060415 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1343/2677] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:56.064841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2da48-34cb-46f5-ae2a-e6aa46614419 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.074364 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2da48-34cb-46f5-ae2a-e6aa46614419 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.078886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c19bde-43e1-47db-84b6-b3ee7b181318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.079545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c19bde-43e1-47db-84b6-b3ee7b181318 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.079823 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c19bde-43e1-47db-84b6-b3ee7b181318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.080093 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c19bde-43e1-47db-84b6-b3ee7b181318 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.080726 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c19bde-43e1-47db-84b6-b3ee7b181318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:40:56.081027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c19bde-43e1-47db-84b6-b3ee7b181318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.082612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c19bde-43e1-47db-84b6-b3ee7b181318 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.093760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1335/2678] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:40:56.098457 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ca3ba-fc43-4225-a598-a7c0f68758a7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.107531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ca3ba-fc43-4225-a598-a7c0f68758a7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.112918 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756a6cf-6409-49a7-a13f-acc68e1381a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.113538 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756a6cf-6409-49a7-a13f-acc68e1381a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.113863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756a6cf-6409-49a7-a13f-acc68e1381a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.114173 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756a6cf-6409-49a7-a13f-acc68e1381a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.114854 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756a6cf-6409-49a7-a13f-acc68e1381a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.116789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756a6cf-6409-49a7-a13f-acc68e1381a5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.147699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1344/2679] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:40:56 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:56.152055 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c19bde-43e1-47db-84b6-b3ee7b181318 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.162758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c19bde-43e1-47db-84b6-b3ee7b181318 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.221335 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af712244-dffe-4c52-a1e0-cdfd7180663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.221946 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712244-dffe-4c52-a1e0-cdfd7180663c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.222223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712244-dffe-4c52-a1e0-cdfd7180663c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.222496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712244-dffe-4c52-a1e0-cdfd7180663c admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.223161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712244-dffe-4c52-a1e0-cdfd7180663c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.225071 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712244-dffe-4c52-a1e0-cdfd7180663c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.247519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1336/2680] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:40:56 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:40:56.252542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756a6cf-6409-49a7-a13f-acc68e1381a5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.263410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756a6cf-6409-49a7-a13f-acc68e1381a5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.269226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00205c89-2371-40a1-9617-621f3c703faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.270229 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00205c89-2371-40a1-9617-621f3c703faf admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.270638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00205c89-2371-40a1-9617-621f3c703faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.271068 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00205c89-2371-40a1-9617-621f3c703faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.272211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00205c89-2371-40a1-9617-621f3c703faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.274756 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00205c89-2371-40a1-9617-621f3c703faf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.287113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1345/2681] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:40:56.291701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af712244-dffe-4c52-a1e0-cdfd7180663c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.303918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af712244-dffe-4c52-a1e0-cdfd7180663c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.310587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c449a-8e0f-4194-87df-d60fe0abe2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.311595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c449a-8e0f-4194-87df-d60fe0abe2ed admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.311874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c449a-8e0f-4194-87df-d60fe0abe2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.312143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c449a-8e0f-4194-87df-d60fe0abe2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.312784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c449a-8e0f-4194-87df-d60fe0abe2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.314560 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c449a-8e0f-4194-87df-d60fe0abe2ed admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.325910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1337/2682] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:40:56.331745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00205c89-2371-40a1-9617-621f3c703faf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.343930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00205c89-2371-40a1-9617-621f3c703faf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.350127 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363833c-a956-4922-89fb-27b67adf7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.350858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363833c-a956-4922-89fb-27b67adf7a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.351139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363833c-a956-4922-89fb-27b67adf7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.351468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363833c-a956-4922-89fb-27b67adf7a7b admin admin] PATH_INFO: `/v3/projects/656357caa09745c79454161a199d7468/users/a121e7c29d8b48c49644f833e3da8ef5/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.369238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363833c-a956-4922-89fb-27b67adf7a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=656357caa09745c79454161a199d7468, user_id=a121e7c29d8b48c49644f833e3da8ef5, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.371919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363833c-a956-4922-89fb-27b67adf7a7b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.387838 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1346/2683] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:56 2022] PUT /identity/v3/projects/656357caa09745c79454161a199d7468/users/a121e7c29d8b48c49644f833e3da8ef5/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:40:56.400191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70bcb9-b9eb-435b-8e15-a09a75308183 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.400546 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70bcb9-b9eb-435b-8e15-a09a75308183 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.400824 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70bcb9-b9eb-435b-8e15-a09a75308183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.415659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:56.433514 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ea70bcb9-b9eb-435b-8e15-a09a75308183 None None] MFA Rules not processed for user `a121e7c29d8b48c49644f833e3da8ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:56.437152 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ea70bcb9-b9eb-435b-8e15-a09a75308183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:56.511176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1338/2684] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:56.515687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363833c-a956-4922-89fb-27b67adf7a7b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.555193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:56.598840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363833c-a956-4922-89fb-27b67adf7a7b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.604043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed386f-30bc-4469-af75-4c5a85c07a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.604727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed386f-30bc-4469-af75-4c5a85c07a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.605007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed386f-30bc-4469-af75-4c5a85c07a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.605275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed386f-30bc-4469-af75-4c5a85c07a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.605981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed386f-30bc-4469-af75-4c5a85c07a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.608303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed386f-30bc-4469-af75-4c5a85c07a1b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.637016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1347/2685] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:40:56 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:56.642543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70bcb9-b9eb-435b-8e15-a09a75308183 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.653711 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70bcb9-b9eb-435b-8e15-a09a75308183 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.715264 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab497e-26a8-42bb-9253-76ce2157577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.715986 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab497e-26a8-42bb-9253-76ce2157577c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.716361 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab497e-26a8-42bb-9253-76ce2157577c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.716673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab497e-26a8-42bb-9253-76ce2157577c admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.717353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab497e-26a8-42bb-9253-76ce2157577c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.719386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab497e-26a8-42bb-9253-76ce2157577c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.739695 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1339/2686] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:40:56 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:56.743750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed386f-30bc-4469-af75-4c5a85c07a1b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.755284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed386f-30bc-4469-af75-4c5a85c07a1b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.759824 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e57b-f9c9-4eaa-82a2-3a7939aa5bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.760399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e57b-f9c9-4eaa-82a2-3a7939aa5bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.760681 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e57b-f9c9-4eaa-82a2-3a7939aa5bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.760947 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e57b-f9c9-4eaa-82a2-3a7939aa5bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.761577 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4e57b-f9c9-4eaa-82a2-3a7939aa5bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.763228 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4e57b-f9c9-4eaa-82a2-3a7939aa5bf4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.774752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1348/2687] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:56.778642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab497e-26a8-42bb-9253-76ce2157577c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.788743 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab497e-26a8-42bb-9253-76ce2157577c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.793383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230efba-61cc-4b47-a7e2-0df97f030c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.793979 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230efba-61cc-4b47-a7e2-0df97f030c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.794261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230efba-61cc-4b47-a7e2-0df97f030c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.794536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230efba-61cc-4b47-a7e2-0df97f030c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.795243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230efba-61cc-4b47-a7e2-0df97f030c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.796831 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230efba-61cc-4b47-a7e2-0df97f030c01 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.806818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1340/2688] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:56.810846 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e57b-f9c9-4eaa-82a2-3a7939aa5bf4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:56.821197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e57b-f9c9-4eaa-82a2-3a7939aa5bf4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:56.825738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262c148-2a10-4c23-8e2f-b24f5984b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:56.826379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262c148-2a10-4c23-8e2f-b24f5984b6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.826658 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262c148-2a10-4c23-8e2f-b24f5984b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.826965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262c148-2a10-4c23-8e2f-b24f5984b6e7 admin admin] PATH_INFO: `/v3/projects/0b8e06d72ad54f7bb0761dceb98fb466/users/d904b571ef91457f96cba84801592c8a/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.841715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262c148-2a10-4c23-8e2f-b24f5984b6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8e06d72ad54f7bb0761dceb98fb466, user_id=d904b571ef91457f96cba84801592c8a, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:56.844406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262c148-2a10-4c23-8e2f-b24f5984b6e7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:56.856996 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1349/2689] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:56 2022] PUT /identity/v3/projects/0b8e06d72ad54f7bb0761dceb98fb466/users/d904b571ef91457f96cba84801592c8a/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:56.866955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062917-5918-4b6e-8ef9-83768fcfbe08 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:56.867247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062917-5918-4b6e-8ef9-83768fcfbe08 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:56.867529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062917-5918-4b6e-8ef9-83768fcfbe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:56.896447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-db062917-5918-4b6e-8ef9-83768fcfbe08 None None] MFA Rules not processed for user `d904b571ef91457f96cba84801592c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:56.897702 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-db062917-5918-4b6e-8ef9-83768fcfbe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:56.966492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1341/2690] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:56.970786 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262c148-2a10-4c23-8e2f-b24f5984b6e7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:57.036036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262c148-2a10-4c23-8e2f-b24f5984b6e7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:57.041876 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6cacc-23f6-48e2-95dc-b05480fcf30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:57.042816 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6cacc-23f6-48e2-95dc-b05480fcf30a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.043288 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6cacc-23f6-48e2-95dc-b05480fcf30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.043566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6cacc-23f6-48e2-95dc-b05480fcf30a admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.044201 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6cacc-23f6-48e2-95dc-b05480fcf30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:57.046113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6cacc-23f6-48e2-95dc-b05480fcf30a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:57.076518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1350/2691] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:40:56 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:40:57.081378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db062917-5918-4b6e-8ef9-83768fcfbe08 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:57.088332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:57.092945 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db062917-5918-4b6e-8ef9-83768fcfbe08 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:57.152406 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c39662-582b-454f-942a-a93f69b3de1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:57.152615 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c39662-582b-454f-942a-a93f69b3de1a admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.152895 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c39662-582b-454f-942a-a93f69b3de1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.153177 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c39662-582b-454f-942a-a93f69b3de1a admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.153800 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c39662-582b-454f-942a-a93f69b3de1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:57.155755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c39662-582b-454f-942a-a93f69b3de1a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:57.178984 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1342/2692] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:40:57 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:40:57.182716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6cacc-23f6-48e2-95dc-b05480fcf30a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:57.193009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6cacc-23f6-48e2-95dc-b05480fcf30a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:57.197617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bd71d-d35b-4ec1-a496-d0bd15e215aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:57.198225 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bd71d-d35b-4ec1-a496-d0bd15e215aa admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.198923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bd71d-d35b-4ec1-a496-d0bd15e215aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.199196 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bd71d-d35b-4ec1-a496-d0bd15e215aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.199857 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bd71d-d35b-4ec1-a496-d0bd15e215aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:57.201451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bd71d-d35b-4ec1-a496-d0bd15e215aa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:57.212939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1351/2693] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:57.217397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c39662-582b-454f-942a-a93f69b3de1a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:57.228025 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c39662-582b-454f-942a-a93f69b3de1a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:57.232629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b89e-7315-43b1-b501-5d8792bd2a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:57.233278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b89e-7315-43b1-b501-5d8792bd2a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.233583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b89e-7315-43b1-b501-5d8792bd2a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.233857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b89e-7315-43b1-b501-5d8792bd2a7b admin admin] PATH_INFO: `/v3/projects/a34b4fb1976945d5bd17d5dbc59ec429/users/26e1cf8897524f5ead5f490c27a3899d/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.248483 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b89e-7315-43b1-b501-5d8792bd2a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34b4fb1976945d5bd17d5dbc59ec429, user_id=26e1cf8897524f5ead5f490c27a3899d, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:57.251315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b89e-7315-43b1-b501-5d8792bd2a7b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:57.263734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1343/2694] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:57 2022] PUT /identity/v3/projects/a34b4fb1976945d5bd17d5dbc59ec429/users/26e1cf8897524f5ead5f490c27a3899d/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:40:57.268230 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bd71d-d35b-4ec1-a496-d0bd15e215aa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:57.278270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bd71d-d35b-4ec1-a496-d0bd15e215aa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:57.330868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:57.341011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b01e2-fe2e-4976-be2c-1ba30e2d2ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:57.341011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b01e2-fe2e-4976-be2c-1ba30e2d2ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.341011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b01e2-fe2e-4976-be2c-1ba30e2d2ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.341011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b01e2-fe2e-4976-be2c-1ba30e2d2ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.341446 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b01e2-fe2e-4976-be2c-1ba30e2d2ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:57.342664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b01e2-fe2e-4976-be2c-1ba30e2d2ec0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:57.357798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1352/2695] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:40:57.361994 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b89e-7315-43b1-b501-5d8792bd2a7b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:57.372102 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b89e-7315-43b1-b501-5d8792bd2a7b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:57.377565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c520139-ee3b-4952-a70b-4f7a62789db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:57.378213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520139-ee3b-4952-a70b-4f7a62789db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.378492 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520139-ee3b-4952-a70b-4f7a62789db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.378808 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520139-ee3b-4952-a70b-4f7a62789db4 admin admin] PATH_INFO: `/v3/projects/a34b4fb1976945d5bd17d5dbc59ec429/users/26e1cf8897524f5ead5f490c27a3899d/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.380710 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520139-ee3b-4952-a70b-4f7a62789db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34b4fb1976945d5bd17d5dbc59ec429, user_id=26e1cf8897524f5ead5f490c27a3899d, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:57.383382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520139-ee3b-4952-a70b-4f7a62789db4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:57.394271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1344/2696] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:40:57 2022] PUT /identity/v3/projects/a34b4fb1976945d5bd17d5dbc59ec429/users/26e1cf8897524f5ead5f490c27a3899d/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:40:57.404549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdd80a-74b9-485f-bc9c-54e99e4a9a29 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.404841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdd80a-74b9-485f-bc9c-54e99e4a9a29 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.405123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdd80a-74b9-485f-bc9c-54e99e4a9a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.432540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c3bdd80a-74b9-485f-bc9c-54e99e4a9a29 None None] MFA Rules not processed for user `26e1cf8897524f5ead5f490c27a3899d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:57.433750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3bdd80a-74b9-485f-bc9c-54e99e4a9a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:57.504732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1353/2697] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:40:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:57.515980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c520139-ee3b-4952-a70b-4f7a62789db4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:57.518245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3c520139-ee3b-4952-a70b-4f7a62789db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:57.574349 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c520139-ee3b-4952-a70b-4f7a62789db4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:57.578001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d226b87-ddb7-42a7-86f6-d185bc6f71a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:57.579196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d226b87-ddb7-42a7-86f6-d185bc6f71a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.579482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d226b87-ddb7-42a7-86f6-d185bc6f71a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.579755 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d226b87-ddb7-42a7-86f6-d185bc6f71a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.588721 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d226b87-ddb7-42a7-86f6-d185bc6f71a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:57.590154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d226b87-ddb7-42a7-86f6-d185bc6f71a9 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:57.600315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1345/2698] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:57.645892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdd80a-74b9-485f-bc9c-54e99e4a9a29 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:57.647327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3bdd80a-74b9-485f-bc9c-54e99e4a9a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:57.662648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdd80a-74b9-485f-bc9c-54e99e4a9a29 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:57.666399 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e3385-a229-4600-9950-0da8a32e38bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:57.667035 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e3385-a229-4600-9950-0da8a32e38bd service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.667321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e3385-a229-4600-9950-0da8a32e38bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.667681 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e3385-a229-4600-9950-0da8a32e38bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.701503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d226b87-ddb7-42a7-86f6-d185bc6f71a9 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:57.704602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3d226b87-ddb7-42a7-86f6-d185bc6f71a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:57.731684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e3385-a229-4600-9950-0da8a32e38bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:57.733034 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e3385-a229-4600-9950-0da8a32e38bd service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:57.742398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1354/2699] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:57.764236 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d226b87-ddb7-42a7-86f6-d185bc6f71a9 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:57.772297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab74dd3-37d7-4f95-acfb-d89edd618ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:57.773290 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74dd3-37d7-4f95-acfb-d89edd618ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.773574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74dd3-37d7-4f95-acfb-d89edd618ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.773846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74dd3-37d7-4f95-acfb-d89edd618ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.775794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bab74dd3-37d7-4f95-acfb-d89edd618ca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:57.789393 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:57.846065 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab74dd3-37d7-4f95-acfb-d89edd618ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:57.848440 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab74dd3-37d7-4f95-acfb-d89edd618ca4 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:57.858208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1346/2700] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:41:00.684809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e3385-a229-4600-9950-0da8a32e38bd service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:00.696362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e3385-a229-4600-9950-0da8a32e38bd service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:00.700868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:00.701511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:00.701774 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:00.702047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] PATH_INFO: `/v3/users/a121e7c29d8b48c49644f833e3da8ef5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:00.704487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a121e7c29d8b48c49644f833e3da8ef5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:00.712939 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:00.778754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a121e7c29d8b48c49644f833e3da8ef5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:00.779942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a121e7c29d8b48c49644f833e3da8ef5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:00.790973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a121e7c29d8b48c49644f833e3da8ef5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:00.791909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a121e7c29d8b48c49644f833e3da8ef5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:00.809757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:00.815470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a121e7c29d8b48c49644f833e3da8ef5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:00.839546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1355/2701] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:41:00 2022] DELETE /identity/v3/users/a121e7c29d8b48c49644f833e3da8ef5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:00.844311 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dadff8-de72-491d-b19a-8f2c05035bfd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:00.844867 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dadff8-de72-491d-b19a-8f2c05035bfd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:00.845857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dadff8-de72-491d-b19a-8f2c05035bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:00.865975 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-f2dadff8-de72-491d-b19a-8f2c05035bfd None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:00.867293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f2dadff8-de72-491d-b19a-8f2c05035bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.004593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1347/2702] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:01.014301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:01.015977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.091290 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce417b-9613-4f70-a370-bf00a486434e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:01.095281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9c625-3dde-4265-9203-13974f18250c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:01.096244 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9c625-3dde-4265-9203-13974f18250c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:01.096627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9c625-3dde-4265-9203-13974f18250c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:01.097003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9c625-3dde-4265-9203-13974f18250c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:01.107085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9c625-3dde-4265-9203-13974f18250c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:01.108733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9c625-3dde-4265-9203-13974f18250c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:01.119982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1356/2703] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:41:01.267360 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dadff8-de72-491d-b19a-8f2c05035bfd None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:01.271658 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f2dadff8-de72-491d-b19a-8f2c05035bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.361038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9c625-3dde-4265-9203-13974f18250c service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:01.363464 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-31b9c625-3dde-4265-9203-13974f18250c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.377559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9c625-3dde-4265-9203-13974f18250c service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:01.382334 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:01.383257 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:01.383539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:01.383809 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] PATH_INFO: `/v3/users/0f98295f825e4d0c8fc54cf9cc07bae4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:01.385008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f98295f825e4d0c8fc54cf9cc07bae4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:01.386969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:01.414225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dadff8-de72-491d-b19a-8f2c05035bfd None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:01.422969 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65bbf1-9604-4c14-b98a-fb7c3634f61d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4030325cf0481ab634e253cfed9c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:01.424199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65bbf1-9604-4c14-b98a-fb7c3634f61d service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:01.424834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65bbf1-9604-4c14-b98a-fb7c3634f61d service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:01.425164 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65bbf1-9604-4c14-b98a-fb7c3634f61d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:01.428670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fd65bbf1-9604-4c14-b98a-fb7c3634f61d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.442852 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65bbf1-9604-4c14-b98a-fb7c3634f61d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:01.444633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65bbf1-9604-4c14-b98a-fb7c3634f61d service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:01.450148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f98295f825e4d0c8fc54cf9cc07bae4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.450897 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f98295f825e4d0c8fc54cf9cc07bae4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.462915 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f98295f825e4d0c8fc54cf9cc07bae4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.463642 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f98295f825e4d0c8fc54cf9cc07bae4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.476446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1348/2704] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:01.477985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f98295f825e4d0c8fc54cf9cc07bae4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.478124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65bbf1-9604-4c14-b98a-fb7c3634f61d service placement] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:01.479934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fd65bbf1-9604-4c14-b98a-fb7c3634f61d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.497190 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1357/2705] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:41:01 2022] DELETE /identity/v3/users/0f98295f825e4d0c8fc54cf9cc07bae4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:41:01.508261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65bbf1-9604-4c14-b98a-fb7c3634f61d service placement] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:01.550033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:01.566725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:01.567449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:01.567730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:01.568003 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] PATH_INFO: `/v3/projects/656357caa09745c79454161a199d7468` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:01.569143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656357caa09745c79454161a199d7468)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:01.571082 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:01.618508 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656357caa09745c79454161a199d7468', 'request_id': 'req-83f192c8-5f81-4185-9843-652b4dc535e6'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.624521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656357caa09745c79454161a199d7468', 'request_id': 'req-83f192c8-5f81-4185-9843-652b4dc535e6'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.630049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656357caa09745c79454161a199d7468', 'request_id': 'req-83f192c8-5f81-4185-9843-652b4dc535e6'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.645291 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] The token cache is being invalidate because project 656357caa09745c79454161a199d7468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:41:01.645675 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.646383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.649626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1349/2706] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:41:01 2022] DELETE /identity/v3/projects/656357caa09745c79454161a199d7468 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:01.653653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:01.655311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.669297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2d5b4-755d-4c00-94de-459e22603f98 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:01.681251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:01.682740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.744705 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:01.745339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:01.745620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:01.745888 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] PATH_INFO: `/v3/users/d904b571ef91457f96cba84801592c8a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:01.747069 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] RBAC: Authorizing `identity:delete_user(user_id=d904b571ef91457f96cba84801592c8a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:01.749040 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:01.751783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:01.761302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f192c8-5f81-4185-9843-652b4dc535e6 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:01.768461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:01.769301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:01.769682 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:01.769952 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] PATH_INFO: `/v3/projects/056882bbdaa0494ba11586fd24fb41fa` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:01.771192 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=056882bbdaa0494ba11586fd24fb41fa)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:01.773389 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:01.801080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd904b571ef91457f96cba84801592c8a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.801841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd904b571ef91457f96cba84801592c8a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.809875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd904b571ef91457f96cba84801592c8a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.810632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd904b571ef91457f96cba84801592c8a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.821843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056882bbdaa0494ba11586fd24fb41fa', 'request_id': 'req-c82f8553-7328-4b94-860a-76eaffb724ba'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.822982 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bc234f5d-e5a6-4c1e-a092-45f353ff94db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd904b571ef91457f96cba84801592c8a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.828217 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056882bbdaa0494ba11586fd24fb41fa', 'request_id': 'req-c82f8553-7328-4b94-860a-76eaffb724ba'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.836472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056882bbdaa0494ba11586fd24fb41fa', 'request_id': 'req-c82f8553-7328-4b94-860a-76eaffb724ba'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.837295 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1358/2707] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:41:01 2022] DELETE /identity/v3/users/d904b571ef91457f96cba84801592c8a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:01.847049 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:01.853998 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] The token cache is being invalidate because project 056882bbdaa0494ba11586fd24fb41fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:41:01.854608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.855935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c82f8553-7328-4b94-860a-76eaffb724ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:01.858373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1350/2708] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:41:01 2022] DELETE /identity/v3/projects/056882bbdaa0494ba11586fd24fb41fa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:41:01.864009 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa404b9c-f4df-40bd-b083-10ce4d8ffd97 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:01.864291 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa404b9c-f4df-40bd-b083-10ce4d8ffd97 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:01.864617 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa404b9c-f4df-40bd-b083-10ce4d8ffd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:01.885018 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fa404b9c-f4df-40bd-b083-10ce4d8ffd97 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:01.886660 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fa404b9c-f4df-40bd-b083-10ce4d8ffd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.953858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1359/2709] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:41:01.964123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be051dd3-a919-4834-b62a-bc2da8e99d4e None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:01.964833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be051dd3-a919-4834-b62a-bc2da8e99d4e None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:01.965117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be051dd3-a919-4834-b62a-bc2da8e99d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:01.999234 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-be051dd3-a919-4834-b62a-bc2da8e99d4e None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:02.000598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-be051dd3-a919-4834-b62a-bc2da8e99d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:02.014794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1351/2710] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:02.015653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa404b9c-f4df-40bd-b083-10ce4d8ffd97 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:02.028506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa404b9c-f4df-40bd-b083-10ce4d8ffd97 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:02.036693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2cc75-beef-4ca3-a615-4a0ebdb1c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:02.037738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2cc75-beef-4ca3-a615-4a0ebdb1c8ca admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.038215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2cc75-beef-4ca3-a615-4a0ebdb1c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.038692 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2cc75-beef-4ca3-a615-4a0ebdb1c8ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.039930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2cc75-beef-4ca3-a615-4a0ebdb1c8ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:41:02.040247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2cc75-beef-4ca3-a615-4a0ebdb1c8ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:02.041875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2cc75-beef-4ca3-a615-4a0ebdb1c8ca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:02.055901 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1360/2711] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:41:02.060297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be051dd3-a919-4834-b62a-bc2da8e99d4e None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:02.092326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be051dd3-a919-4834-b62a-bc2da8e99d4e None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:02.097786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6ef4e-df96-4a76-8e47-c120ce128d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:02.098942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6ef4e-df96-4a76-8e47-c120ce128d4e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.098942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6ef4e-df96-4a76-8e47-c120ce128d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.099791 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6ef4e-df96-4a76-8e47-c120ce128d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.100683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6ef4e-df96-4a76-8e47-c120ce128d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:02.102688 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6ef4e-df96-4a76-8e47-c120ce128d4e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:02.135033 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1352/2712] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:41:02 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:41:02.136382 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2cc75-beef-4ca3-a615-4a0ebdb1c8ca admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:02.147029 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2cc75-beef-4ca3-a615-4a0ebdb1c8ca admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:02.206241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60314dfe-8a7f-4521-a912-723fb21aaba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:02.206821 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314dfe-8a7f-4521-a912-723fb21aaba5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.207102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314dfe-8a7f-4521-a912-723fb21aaba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.207374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314dfe-8a7f-4521-a912-723fb21aaba5 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.208010 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60314dfe-8a7f-4521-a912-723fb21aaba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:02.210063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60314dfe-8a7f-4521-a912-723fb21aaba5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:02.227401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:02.235296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1361/2713] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:41:02 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:41:02.240304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6ef4e-df96-4a76-8e47-c120ce128d4e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:02.254330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6ef4e-df96-4a76-8e47-c120ce128d4e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:02.259796 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098826b8-7880-4ffe-80fc-a2334fc464b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:02.260621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098826b8-7880-4ffe-80fc-a2334fc464b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.261015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098826b8-7880-4ffe-80fc-a2334fc464b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.261419 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098826b8-7880-4ffe-80fc-a2334fc464b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.262162 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098826b8-7880-4ffe-80fc-a2334fc464b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:02.264052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098826b8-7880-4ffe-80fc-a2334fc464b3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:02.279246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1353/2714] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:41:02.280832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60314dfe-8a7f-4521-a912-723fb21aaba5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:02.296034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098826b8-7880-4ffe-80fc-a2334fc464b3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:02.298582 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-098826b8-7880-4ffe-80fc-a2334fc464b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:02.299940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60314dfe-8a7f-4521-a912-723fb21aaba5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:02.311344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a4af-637b-428b-9431-214da04daa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:02.312579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a4af-637b-428b-9431-214da04daa41 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.313091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a4af-637b-428b-9431-214da04daa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.313463 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a4af-637b-428b-9431-214da04daa41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.315396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098826b8-7880-4ffe-80fc-a2334fc464b3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:02.315563 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804a4af-637b-428b-9431-214da04daa41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:02.317383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804a4af-637b-428b-9431-214da04daa41 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:02.320836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:02.321476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.321758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.322445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] PATH_INFO: `/v3/projects/0b8e06d72ad54f7bb0761dceb98fb466` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.323372 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8e06d72ad54f7bb0761dceb98fb466)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:02.326024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:02.344153 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1362/2715] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:41:02.346742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a4af-637b-428b-9431-214da04daa41 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:02.369592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a4af-637b-428b-9431-214da04daa41 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:02.383451 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7a7bb-8c1c-46ee-96e1-46dcdf602f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:02.384133 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a7bb-8c1c-46ee-96e1-46dcdf602f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.384460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a7bb-8c1c-46ee-96e1-46dcdf602f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.384733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a7bb-8c1c-46ee-96e1-46dcdf602f9b admin admin] PATH_INFO: `/v3/projects/57241696da8a4f9a887d693d9f281661/users/569e47572bc440ebb25d217415141e6d/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.405378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8e06d72ad54f7bb0761dceb98fb466', 'request_id': 'req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:02.408913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7a7bb-8c1c-46ee-96e1-46dcdf602f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57241696da8a4f9a887d693d9f281661, user_id=569e47572bc440ebb25d217415141e6d, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:02.411814 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7a7bb-8c1c-46ee-96e1-46dcdf602f9b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:02.414329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8e06d72ad54f7bb0761dceb98fb466', 'request_id': 'req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:02.421934 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8e06d72ad54f7bb0761dceb98fb466', 'request_id': 'req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:02.432043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1363/2716] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:41:02 2022] PUT /identity/v3/projects/57241696da8a4f9a887d693d9f281661/users/569e47572bc440ebb25d217415141e6d/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:41:02.437945 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68875-227d-4b7a-aa84-f20a6df56f69 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.438236 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68875-227d-4b7a-aa84-f20a6df56f69 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.438524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68875-227d-4b7a-aa84-f20a6df56f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.445678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] The token cache is being invalidate because project 0b8e06d72ad54f7bb0761dceb98fb466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:41:02.446535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:02.450350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:02.455383 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1354/2717] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:41:02 2022] DELETE /identity/v3/projects/0b8e06d72ad54f7bb0761dceb98fb466 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:02.456785 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:02.462593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-59f68875-227d-4b7a-aa84-f20a6df56f69 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:02.463995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:02.464135 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-59f68875-227d-4b7a-aa84-f20a6df56f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:02.536870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1364/2718] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:02.547728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68875-227d-4b7a-aa84-f20a6df56f69 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:02.549604 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-59f68875-227d-4b7a-aa84-f20a6df56f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:02.553467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6fc6c-7fc9-4c68-9afd-19becc90e8bb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:02.557368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:02.557995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.558271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.558541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] PATH_INFO: `/v3/users/26e1cf8897524f5ead5f490c27a3899d` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.559719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e1cf8897524f5ead5f490c27a3899d)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:02.561632 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:02.611927 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68875-227d-4b7a-aa84-f20a6df56f69 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:02.613229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:02.615244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e1cf8897524f5ead5f490c27a3899d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:02.615911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e1cf8897524f5ead5f490c27a3899d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:02.616990 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d942-c51c-4420-b6d0-5b35c9a4c19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:02.617607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d942-c51c-4420-b6d0-5b35c9a4c19e service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.617896 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d942-c51c-4420-b6d0-5b35c9a4c19e service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.618161 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d942-c51c-4420-b6d0-5b35c9a4c19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.628584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5d942-c51c-4420-b6d0-5b35c9a4c19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:02.630029 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5d942-c51c-4420-b6d0-5b35c9a4c19e service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:02.632140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e1cf8897524f5ead5f490c27a3899d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:02.641995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e1cf8897524f5ead5f490c27a3899d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:02.642514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1365/2719] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:02.643486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2b42c22d-deca-4abd-8e9f-c07ad98a264b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e1cf8897524f5ead5f490c27a3899d'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:02.659275 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1355/2720] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:41:02 2022] DELETE /identity/v3/users/26e1cf8897524f5ead5f490c27a3899d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:41:03.050219 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d942-c51c-4420-b6d0-5b35c9a4c19e service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:03.063206 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d942-c51c-4420-b6d0-5b35c9a4c19e service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:03.141008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:03.141650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.142489 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.142858 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] PATH_INFO: `/v3/projects/a34b4fb1976945d5bd17d5dbc59ec429` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.144157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34b4fb1976945d5bd17d5dbc59ec429)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:03.146096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:03.155674 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:03.200494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34b4fb1976945d5bd17d5dbc59ec429', 'request_id': 'req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:03.207193 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34b4fb1976945d5bd17d5dbc59ec429', 'request_id': 'req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:03.214006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34b4fb1976945d5bd17d5dbc59ec429', 'request_id': 'req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:03.227730 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] The token cache is being invalidate because project a34b4fb1976945d5bd17d5dbc59ec429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:41:03.228072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:03.228772 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70c7b6e6-ebc5-40eb-aa87-a4802ef8d1ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:03.230256 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1366/2721] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:41:03 2022] DELETE /identity/v3/projects/a34b4fb1976945d5bd17d5dbc59ec429 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:03.236213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a11e7-7525-4ef9-b8e3-f26d4ba3b00b None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.236761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a11e7-7525-4ef9-b8e3-f26d4ba3b00b None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.236761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a11e7-7525-4ef9-b8e3-f26d4ba3b00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.256506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-1a9a11e7-7525-4ef9-b8e3-f26d4ba3b00b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:03.257842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-1a9a11e7-7525-4ef9-b8e3-f26d4ba3b00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:03.333019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1356/2722] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:03.337100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f44ee9-93ef-4710-9b8a-7f1b006afdaf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.337479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f44ee9-93ef-4710-9b8a-7f1b006afdaf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.338104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f44ee9-93ef-4710-9b8a-7f1b006afdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.384787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-00f44ee9-93ef-4710-9b8a-7f1b006afdaf None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:03.386304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-00f44ee9-93ef-4710-9b8a-7f1b006afdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:03.398572 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1367/2723] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:03.403185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a11e7-7525-4ef9-b8e3-f26d4ba3b00b None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:03.416983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a11e7-7525-4ef9-b8e3-f26d4ba3b00b None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:03.422557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397f29a-fef9-40fe-afdb-aad0a734abdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:03.423911 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397f29a-fef9-40fe-afdb-aad0a734abdc admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.424219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397f29a-fef9-40fe-afdb-aad0a734abdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.424743 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397f29a-fef9-40fe-afdb-aad0a734abdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.425402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397f29a-fef9-40fe-afdb-aad0a734abdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:41:03.425707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397f29a-fef9-40fe-afdb-aad0a734abdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:03.427356 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397f29a-fef9-40fe-afdb-aad0a734abdc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:03.447473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1357/2724] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:41:03.451473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f44ee9-93ef-4710-9b8a-7f1b006afdaf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:03.467839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f44ee9-93ef-4710-9b8a-7f1b006afdaf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:03.471693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af09f-9242-4f5c-b102-845e53919755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:03.473656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af09f-9242-4f5c-b102-845e53919755 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.474067 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af09f-9242-4f5c-b102-845e53919755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.474441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af09f-9242-4f5c-b102-845e53919755 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.475790 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af09f-9242-4f5c-b102-845e53919755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:03.478841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af09f-9242-4f5c-b102-845e53919755 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:03.525352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1368/2725] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:41:03 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:41:03.530195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397f29a-fef9-40fe-afdb-aad0a734abdc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:03.546354 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397f29a-fef9-40fe-afdb-aad0a734abdc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:03.623019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b0afe-f7a1-45dd-80ed-ba200ead7337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:03.623929 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b0afe-f7a1-45dd-80ed-ba200ead7337 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.624330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b0afe-f7a1-45dd-80ed-ba200ead7337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.624708 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b0afe-f7a1-45dd-80ed-ba200ead7337 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.625458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b0afe-f7a1-45dd-80ed-ba200ead7337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:03.628459 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b0afe-f7a1-45dd-80ed-ba200ead7337 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:03.651713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1358/2726] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:41:03 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:41:03.655608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af09f-9242-4f5c-b102-845e53919755 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:03.668615 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af09f-9242-4f5c-b102-845e53919755 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:03.675384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67abea-42e5-4154-894e-14f80a6ac71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:03.677072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67abea-42e5-4154-894e-14f80a6ac71b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.677072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67abea-42e5-4154-894e-14f80a6ac71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.677072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67abea-42e5-4154-894e-14f80a6ac71b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.677573 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67abea-42e5-4154-894e-14f80a6ac71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:03.679316 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67abea-42e5-4154-894e-14f80a6ac71b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:03.691227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1369/2727] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:41:03.695333 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b0afe-f7a1-45dd-80ed-ba200ead7337 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:03.707825 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b0afe-f7a1-45dd-80ed-ba200ead7337 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:03.713249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec62c8-c37a-48f2-97d8-25db0122f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:03.714129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec62c8-c37a-48f2-97d8-25db0122f90b admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.714538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec62c8-c37a-48f2-97d8-25db0122f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.715237 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec62c8-c37a-48f2-97d8-25db0122f90b admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.715849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec62c8-c37a-48f2-97d8-25db0122f90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:03.717762 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec62c8-c37a-48f2-97d8-25db0122f90b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:03.732678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1359/2728] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:41:03.733856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67abea-42e5-4154-894e-14f80a6ac71b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:03.746713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67abea-42e5-4154-894e-14f80a6ac71b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:03.755404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcdc5-6ad3-4c51-bc94-17084b678ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:03.756732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcdc5-6ad3-4c51-bc94-17084b678ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.757307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcdc5-6ad3-4c51-bc94-17084b678ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.757841 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcdc5-6ad3-4c51-bc94-17084b678ce7 admin admin] PATH_INFO: `/v3/projects/f3383bb1963d4bb78b4f583130813d79/users/9ea60d0e957d4b64bc969dc3201d7d96/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.776747 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbcdc5-6ad3-4c51-bc94-17084b678ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3383bb1963d4bb78b4f583130813d79, user_id=9ea60d0e957d4b64bc969dc3201d7d96, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:03.780185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbcdc5-6ad3-4c51-bc94-17084b678ce7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:03.795926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1370/2729] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:41:03 2022] PUT /identity/v3/projects/f3383bb1963d4bb78b4f583130813d79/users/9ea60d0e957d4b64bc969dc3201d7d96/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:03.809591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfa234-4f9a-48ca-9af0-c769a853cbb5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.809873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfa234-4f9a-48ca-9af0-c769a853cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.810261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfa234-4f9a-48ca-9af0-c769a853cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.841157 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-34cfa234-4f9a-48ca-9af0-c769a853cbb5 None None] MFA Rules not processed for user `9ea60d0e957d4b64bc969dc3201d7d96`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:03.842378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-34cfa234-4f9a-48ca-9af0-c769a853cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:03.864117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:03.928538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1360/2730] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:03.929992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcdc5-6ad3-4c51-bc94-17084b678ce7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:03.996301 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcdc5-6ad3-4c51-bc94-17084b678ce7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:04.002056 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4c394-b859-40b1-9ffa-e6c00bae094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:04.002708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4c394-b859-40b1-9ffa-e6c00bae094a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:04.003002 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4c394-b859-40b1-9ffa-e6c00bae094a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:04.003260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4c394-b859-40b1-9ffa-e6c00bae094a admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:04.003894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4c394-b859-40b1-9ffa-e6c00bae094a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:04.005837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4c394-b859-40b1-9ffa-e6c00bae094a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:04.037185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1371/2731] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:41:03 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:41:04.041332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfa234-4f9a-48ca-9af0-c769a853cbb5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:04.054661 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfa234-4f9a-48ca-9af0-c769a853cbb5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:04.119838 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f654b0-7aa5-4bdb-87d7-908bd4e70abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:04.120668 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f654b0-7aa5-4bdb-87d7-908bd4e70abb admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:04.121030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f654b0-7aa5-4bdb-87d7-908bd4e70abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:04.121403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f654b0-7aa5-4bdb-87d7-908bd4e70abb admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:04.122098 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f654b0-7aa5-4bdb-87d7-908bd4e70abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:04.124167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f654b0-7aa5-4bdb-87d7-908bd4e70abb admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:04.149769 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1361/2732] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:41:04 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:41:04.154268 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4c394-b859-40b1-9ffa-e6c00bae094a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:04.168021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4c394-b859-40b1-9ffa-e6c00bae094a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:04.175053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b291a-131a-4477-83d2-c3d40c5dc353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:04.175708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b291a-131a-4477-83d2-c3d40c5dc353 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:04.175992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b291a-131a-4477-83d2-c3d40c5dc353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:04.176279 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b291a-131a-4477-83d2-c3d40c5dc353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:04.176953 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b291a-131a-4477-83d2-c3d40c5dc353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:04.178575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b291a-131a-4477-83d2-c3d40c5dc353 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:04.195975 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1372/2733] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:41:04.197217 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f654b0-7aa5-4bdb-87d7-908bd4e70abb admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:04.212615 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f654b0-7aa5-4bdb-87d7-908bd4e70abb admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:04.218721 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e04a7-c9a9-4725-b475-33ca6f96e7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:04.219618 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e04a7-c9a9-4725-b475-33ca6f96e7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:04.220707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e04a7-c9a9-4725-b475-33ca6f96e7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:04.221339 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e04a7-c9a9-4725-b475-33ca6f96e7e2 admin admin] PATH_INFO: `/v3/projects/33d22600a68841bc9b7e3ed72ffbb093/users/cf6663e9e484410bab3aa5977de75a49/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:04.237840 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e04a7-c9a9-4725-b475-33ca6f96e7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d22600a68841bc9b7e3ed72ffbb093, user_id=cf6663e9e484410bab3aa5977de75a49, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:04.240886 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e04a7-c9a9-4725-b475-33ca6f96e7e2 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:04.264056 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1362/2734] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:41:04 2022] PUT /identity/v3/projects/33d22600a68841bc9b7e3ed72ffbb093/users/cf6663e9e484410bab3aa5977de75a49/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:04.268678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b291a-131a-4477-83d2-c3d40c5dc353 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:04.280568 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b291a-131a-4477-83d2-c3d40c5dc353 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:04.286080 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:04.377507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb04f3-f056-4cc7-a9b8-e058af58ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:04.379631 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb04f3-f056-4cc7-a9b8-e058af58ad7b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:04.380011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb04f3-f056-4cc7-a9b8-e058af58ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:04.381728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb04f3-f056-4cc7-a9b8-e058af58ad7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:04.381728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb04f3-f056-4cc7-a9b8-e058af58ad7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:04.383512 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb04f3-f056-4cc7-a9b8-e058af58ad7b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:04.408682 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1373/2735] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:41:04.409455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e04a7-c9a9-4725-b475-33ca6f96e7e2 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:04.423520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e04a7-c9a9-4725-b475-33ca6f96e7e2 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:04.439019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aa000-027c-487c-85ff-9bcff86ab526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:04.440358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aa000-027c-487c-85ff-9bcff86ab526 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:04.440827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aa000-027c-487c-85ff-9bcff86ab526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:04.441266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aa000-027c-487c-85ff-9bcff86ab526 admin admin] PATH_INFO: `/v3/projects/33d22600a68841bc9b7e3ed72ffbb093/users/cf6663e9e484410bab3aa5977de75a49/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:04.443538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aa000-027c-487c-85ff-9bcff86ab526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d22600a68841bc9b7e3ed72ffbb093, user_id=cf6663e9e484410bab3aa5977de75a49, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:04.446365 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aa000-027c-487c-85ff-9bcff86ab526 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:04.490779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1363/2736] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:41:04 2022] PUT /identity/v3/projects/33d22600a68841bc9b7e3ed72ffbb093/users/cf6663e9e484410bab3aa5977de75a49/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:04.496423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70ca6-5841-4f28-a9f7-974e5af21dfd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:04.496551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70ca6-5841-4f28-a9f7-974e5af21dfd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:04.496783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70ca6-5841-4f28-a9f7-974e5af21dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:04.571100 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ccd70ca6-5841-4f28-a9f7-974e5af21dfd None None] MFA Rules not processed for user `cf6663e9e484410bab3aa5977de75a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:04.572496 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ccd70ca6-5841-4f28-a9f7-974e5af21dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:04.703678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1374/2737] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:04.715898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aa000-027c-487c-85ff-9bcff86ab526 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:04.718323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-153aa000-027c-487c-85ff-9bcff86ab526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:04.833820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aa000-027c-487c-85ff-9bcff86ab526 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:04.837833 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f62871-22b0-443a-a639-a4f47017948d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:04.838468 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62871-22b0-443a-a639-a4f47017948d service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:04.838784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62871-22b0-443a-a639-a4f47017948d service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:04.839063 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62871-22b0-443a-a639-a4f47017948d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:04.852014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f62871-22b0-443a-a639-a4f47017948d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:04.853575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f62871-22b0-443a-a639-a4f47017948d service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:04.869104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1364/2738] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:05.383751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70ca6-5841-4f28-a9f7-974e5af21dfd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:05.457226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70ca6-5841-4f28-a9f7-974e5af21dfd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:05.462324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:05.463215 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:05.463789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:05.464216 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] PATH_INFO: `/v3/users/9ea60d0e957d4b64bc969dc3201d7d96` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:05.465547 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea60d0e957d4b64bc969dc3201d7d96)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:05.467698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:05.513016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:05.531794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea60d0e957d4b64bc969dc3201d7d96'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:05.532556 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea60d0e957d4b64bc969dc3201d7d96'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:05.542324 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea60d0e957d4b64bc969dc3201d7d96'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:05.543724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea60d0e957d4b64bc969dc3201d7d96'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:05.564724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea60d0e957d4b64bc969dc3201d7d96'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:05.579978 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1375/2739] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:41:05 2022] DELETE /identity/v3/users/9ea60d0e957d4b64bc969dc3201d7d96 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:05.584191 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc738-2151-40da-b6be-d342176098f6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:05.584725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc738-2151-40da-b6be-d342176098f6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:05.584989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc738-2151-40da-b6be-d342176098f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:05.606436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-180cc738-2151-40da-b6be-d342176098f6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:05.607762 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-180cc738-2151-40da-b6be-d342176098f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:05.617565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:05.823353 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1365/2740] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:05.838138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:05.839847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:05.906523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4138cd3-804f-4ff8-8228-175eb9dd7e8d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:05.911385 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9084f9-56c8-435f-972f-6d0a74696a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:05.912015 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9084f9-56c8-435f-972f-6d0a74696a32 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:05.912293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9084f9-56c8-435f-972f-6d0a74696a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:05.912564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9084f9-56c8-435f-972f-6d0a74696a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:05.923432 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9084f9-56c8-435f-972f-6d0a74696a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:05.925349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9084f9-56c8-435f-972f-6d0a74696a32 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:05.936962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1376/2741] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:06.281303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cc738-2151-40da-b6be-d342176098f6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:06.283827 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-180cc738-2151-40da-b6be-d342176098f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:06.310992 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cc738-2151-40da-b6be-d342176098f6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:06.317797 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:06.318727 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:06.319786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:06.320053 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] PATH_INFO: `/v3/projects/f3383bb1963d4bb78b4f583130813d79` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:06.321491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3383bb1963d4bb78b4f583130813d79)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:06.324150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:06.383659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3383bb1963d4bb78b4f583130813d79', 'request_id': 'req-5467dfe2-76a4-4263-a3f0-2d267a8e18be'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:06.390235 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3383bb1963d4bb78b4f583130813d79', 'request_id': 'req-5467dfe2-76a4-4263-a3f0-2d267a8e18be'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:06.397461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3383bb1963d4bb78b4f583130813d79', 'request_id': 'req-5467dfe2-76a4-4263-a3f0-2d267a8e18be'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:06.416141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] The token cache is being invalidate because project f3383bb1963d4bb78b4f583130813d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:41:06.416703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:06.417542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:06.419625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1366/2742] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:41:06 2022] DELETE /identity/v3/projects/f3383bb1963d4bb78b4f583130813d79 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:06.423442 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9084f9-56c8-435f-972f-6d0a74696a32 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:06.435145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9084f9-56c8-435f-972f-6d0a74696a32 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:06.543832 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:06.544602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:06.545054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:06.545422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] PATH_INFO: `/v3/users/cf6663e9e484410bab3aa5977de75a49` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:06.546701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6663e9e484410bab3aa5977de75a49)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:06.549478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:06.759557 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6663e9e484410bab3aa5977de75a49'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:06.760758 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6663e9e484410bab3aa5977de75a49'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:06.767045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:06.771360 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6663e9e484410bab3aa5977de75a49'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:06.773155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6663e9e484410bab3aa5977de75a49'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:06.791794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-77d87cef-a47c-4931-b629-1034620f7f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6663e9e484410bab3aa5977de75a49'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:06.809624 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1377/2743] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:41:06 2022] DELETE /identity/v3/users/cf6663e9e484410bab3aa5977de75a49 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:07.157943 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:07.161118 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:07.205551 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467dfe2-76a4-4263-a3f0-2d267a8e18be admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:07.329110 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:07.331222 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.331645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.332261 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] PATH_INFO: `/v3/projects/33d22600a68841bc9b7e3ed72ffbb093` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.334248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d22600a68841bc9b7e3ed72ffbb093)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:07.337148 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:07.390351 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178d926-875d-4ace-b892-f259d24db9ca None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.390641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178d926-875d-4ace-b892-f259d24db9ca None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.391000 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178d926-875d-4ace-b892-f259d24db9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.403470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:07.421382 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d22600a68841bc9b7e3ed72ffbb093', 'request_id': 'req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:07.433523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5178d926-875d-4ace-b892-f259d24db9ca None None] MFA Rules not processed for user `569e47572bc440ebb25d217415141e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:07.438855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5178d926-875d-4ace-b892-f259d24db9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:07.438948 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d22600a68841bc9b7e3ed72ffbb093', 'request_id': 'req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:07.452467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d22600a68841bc9b7e3ed72ffbb093', 'request_id': 'req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:07.476557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] The token cache is being invalidate because project 33d22600a68841bc9b7e3ed72ffbb093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:41:07.476800 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:07.477684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-80bc2ccb-e5b0-4e19-b92f-1370a0b6bbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:07.486427 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1367/2744] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:41:07 2022] DELETE /identity/v3/projects/33d22600a68841bc9b7e3ed72ffbb093 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:07.488238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512da6-2a9d-4b3f-89a0-6d1b6d7dc8a9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.488598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512da6-2a9d-4b3f-89a0-6d1b6d7dc8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.488873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512da6-2a9d-4b3f-89a0-6d1b6d7dc8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.518859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-90512da6-2a9d-4b3f-89a0-6d1b6d7dc8a9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:07.520139 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-90512da6-2a9d-4b3f-89a0-6d1b6d7dc8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:07.541238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1378/2745] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:41:07.555810 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178d926-875d-4ace-b892-f259d24db9ca None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:07.557400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5178d926-875d-4ace-b892-f259d24db9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:07.592139 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1368/2746] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:07.600543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfcd5b-220c-4224-aba6-59e95d240ff7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.600826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfcd5b-220c-4224-aba6-59e95d240ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.601103 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfcd5b-220c-4224-aba6-59e95d240ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.623815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-94dfcd5b-220c-4224-aba6-59e95d240ff7 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:07.625303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-94dfcd5b-220c-4224-aba6-59e95d240ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:07.637967 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1369/2747] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:41:07.639009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfcd5b-220c-4224-aba6-59e95d240ff7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:07.644494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178d926-875d-4ace-b892-f259d24db9ca None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:07.650328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfcd5b-220c-4224-aba6-59e95d240ff7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:07.666429 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6be15f-8756-4c19-ad8d-f4ba373df862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:07.667934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6be15f-8756-4c19-ad8d-f4ba373df862 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.668218 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6be15f-8756-4c19-ad8d-f4ba373df862 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.668499 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6be15f-8756-4c19-ad8d-f4ba373df862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.669919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be1ec1-d46b-4f62-b8b0-0aa392ec9a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:07.670523 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1ec1-d46b-4f62-b8b0-0aa392ec9a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.670900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1ec1-d46b-4f62-b8b0-0aa392ec9a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.673356 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1ec1-d46b-4f62-b8b0-0aa392ec9a07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.673356 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be1ec1-d46b-4f62-b8b0-0aa392ec9a07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:41:07.673636 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be1ec1-d46b-4f62-b8b0-0aa392ec9a07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:07.676022 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be1ec1-d46b-4f62-b8b0-0aa392ec9a07 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:07.682567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6be15f-8756-4c19-ad8d-f4ba373df862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:07.685407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6be15f-8756-4c19-ad8d-f4ba373df862 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:07.694253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1370/2748] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:41:07.698464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be1ec1-d46b-4f62-b8b0-0aa392ec9a07 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:07.700656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1379/2749] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:41:07.708515 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be1ec1-d46b-4f62-b8b0-0aa392ec9a07 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:07.713438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb6252-6ed4-4b53-ae8a-39e7a94dde7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:07.713930 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb6252-6ed4-4b53-ae8a-39e7a94dde7f admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.714252 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb6252-6ed4-4b53-ae8a-39e7a94dde7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.714471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb6252-6ed4-4b53-ae8a-39e7a94dde7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.715195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb6252-6ed4-4b53-ae8a-39e7a94dde7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:07.718559 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb6252-6ed4-4b53-ae8a-39e7a94dde7f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:07.763616 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1371/2750] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:41:07 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:41:07.766789 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6be15f-8756-4c19-ad8d-f4ba373df862 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:07.778492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6be15f-8756-4c19-ad8d-f4ba373df862 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:07.837853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:07.864271 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3afa2-41f0-459a-b4e6-6c3686d01cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:07.865220 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3afa2-41f0-459a-b4e6-6c3686d01cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.865603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3afa2-41f0-459a-b4e6-6c3686d01cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.865940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3afa2-41f0-459a-b4e6-6c3686d01cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.866643 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3afa2-41f0-459a-b4e6-6c3686d01cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:07.868726 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3afa2-41f0-459a-b4e6-6c3686d01cb0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:07.898443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1380/2751] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:41:07 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:41:07.899730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb6252-6ed4-4b53-ae8a-39e7a94dde7f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:07.911141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb6252-6ed4-4b53-ae8a-39e7a94dde7f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:07.919655 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa00c9-db25-4326-b0b5-f11adf98a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:07.920350 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa00c9-db25-4326-b0b5-f11adf98a8be admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.920628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa00c9-db25-4326-b0b5-f11adf98a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.920989 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa00c9-db25-4326-b0b5-f11adf98a8be admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.921818 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa00c9-db25-4326-b0b5-f11adf98a8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:07.924305 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa00c9-db25-4326-b0b5-f11adf98a8be admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:07.940826 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1372/2752] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:41:07.944963 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3afa2-41f0-459a-b4e6-6c3686d01cb0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:07.961595 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3afa2-41f0-459a-b4e6-6c3686d01cb0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:07.968051 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d696ab-8a51-4230-b01f-3781938df4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:07.968895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d696ab-8a51-4230-b01f-3781938df4cc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.969184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d696ab-8a51-4230-b01f-3781938df4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.969483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d696ab-8a51-4230-b01f-3781938df4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.970456 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d696ab-8a51-4230-b01f-3781938df4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:07.972247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d696ab-8a51-4230-b01f-3781938df4cc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:07.986983 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1381/2753] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:41:07.991288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa00c9-db25-4326-b0b5-f11adf98a8be admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:08.003899 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa00c9-db25-4326-b0b5-f11adf98a8be admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:08.009246 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dd850-64ce-4198-a7fc-afc209b9a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:08.010001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dd850-64ce-4198-a7fc-afc209b9a5d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:08.010254 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dd850-64ce-4198-a7fc-afc209b9a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:08.010747 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dd850-64ce-4198-a7fc-afc209b9a5d4 admin admin] PATH_INFO: `/v3/projects/798cb69ce3864e09b78243635e07b1b5/users/131e3239165a48a9b90a778cd894755b/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:08.032266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dd850-64ce-4198-a7fc-afc209b9a5d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798cb69ce3864e09b78243635e07b1b5, user_id=131e3239165a48a9b90a778cd894755b, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:08.036599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dd850-64ce-4198-a7fc-afc209b9a5d4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:08.053748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1373/2754] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:41:07 2022] PUT /identity/v3/projects/798cb69ce3864e09b78243635e07b1b5/users/131e3239165a48a9b90a778cd894755b/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:08.065091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b074f-09b0-4c03-8ecc-fcc55ea262e1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:08.065370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b074f-09b0-4c03-8ecc-fcc55ea262e1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:08.065651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b074f-09b0-4c03-8ecc-fcc55ea262e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:08.098711 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-070b074f-09b0-4c03-8ecc-fcc55ea262e1 None None] MFA Rules not processed for user `131e3239165a48a9b90a778cd894755b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:08.099989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-070b074f-09b0-4c03-8ecc-fcc55ea262e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:08.187555 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1382/2755] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:08.204009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dd850-64ce-4198-a7fc-afc209b9a5d4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:08.207640 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-807dd850-64ce-4198-a7fc-afc209b9a5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:08.292465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dd850-64ce-4198-a7fc-afc209b9a5d4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:08.298535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b85be2-1e20-4154-a6c9-488d28b8f6a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:08.299465 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85be2-1e20-4154-a6c9-488d28b8f6a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:08.299942 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85be2-1e20-4154-a6c9-488d28b8f6a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:08.300224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85be2-1e20-4154-a6c9-488d28b8f6a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:08.308475 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:08.319042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85be2-1e20-4154-a6c9-488d28b8f6a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:08.320501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85be2-1e20-4154-a6c9-488d28b8f6a5 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:08.331898 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1374/2756] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:08.357536 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b074f-09b0-4c03-8ecc-fcc55ea262e1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:08.429281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b074f-09b0-4c03-8ecc-fcc55ea262e1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:08.435983 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:08.436784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:08.437124 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:08.437567 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] PATH_INFO: `/v3/users/131e3239165a48a9b90a778cd894755b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:08.439522 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131e3239165a48a9b90a778cd894755b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:08.441619 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:08.508574 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131e3239165a48a9b90a778cd894755b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:08.510192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131e3239165a48a9b90a778cd894755b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:08.521987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:08.527389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131e3239165a48a9b90a778cd894755b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:08.541235 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131e3239165a48a9b90a778cd894755b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:08.541799 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab3827-a4a8-4d33-bf34-1d677f4956b7 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:08.542436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab3827-a4a8-4d33-bf34-1d677f4956b7 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:08.542940 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab3827-a4a8-4d33-bf34-1d677f4956b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:08.573619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bfab3827-a4a8-4d33-bf34-1d677f4956b7 None None] MFA Rules not processed for user `09d59ef21d214b6fba670d1449d887f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:08.574882 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bfab3827-a4a8-4d33-bf34-1d677f4956b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:08.576923 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-73f118cc-bc96-468b-8e65-1d4e9f755433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131e3239165a48a9b90a778cd894755b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:08.602729 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1383/2757] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:41:08 2022] DELETE /identity/v3/users/131e3239165a48a9b90a778cd894755b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:08.606214 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0e080-c197-4a89-b48a-d25ed635a92d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:08.606687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0e080-c197-4a89-b48a-d25ed635a92d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:08.607709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0e080-c197-4a89-b48a-d25ed635a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:08.636614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-60d0e080-c197-4a89-b48a-d25ed635a92d None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:08.637952 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-60d0e080-c197-4a89-b48a-d25ed635a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:08.687343 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1375/2758] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:08.742998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1384/2759] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:08.752525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab3827-a4a8-4d33-bf34-1d677f4956b7 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:08.754244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bfab3827-a4a8-4d33-bf34-1d677f4956b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:08.842591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab3827-a4a8-4d33-bf34-1d677f4956b7 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:08.905719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67e54f-91bd-423a-a702-730019aef391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:08.905887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e54f-91bd-423a-a702-730019aef391 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:08.906047 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e54f-91bd-423a-a702-730019aef391 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:08.906323 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e54f-91bd-423a-a702-730019aef391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:08.919265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67e54f-91bd-423a-a702-730019aef391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:08.920925 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67e54f-91bd-423a-a702-730019aef391 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:08.933295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1376/2760] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:09.240013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0e080-c197-4a89-b48a-d25ed635a92d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:09.241493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-60d0e080-c197-4a89-b48a-d25ed635a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:09.254198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0e080-c197-4a89-b48a-d25ed635a92d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:09.259721 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:09.260376 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:09.260656 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:09.260930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] PATH_INFO: `/v3/projects/798cb69ce3864e09b78243635e07b1b5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:09.262093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=798cb69ce3864e09b78243635e07b1b5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:09.264050 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:09.321560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798cb69ce3864e09b78243635e07b1b5', 'request_id': 'req-055f0cf5-d318-4be4-ada7-f51f0818a5ae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:09.327770 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798cb69ce3864e09b78243635e07b1b5', 'request_id': 'req-055f0cf5-d318-4be4-ada7-f51f0818a5ae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:09.334544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798cb69ce3864e09b78243635e07b1b5', 'request_id': 'req-055f0cf5-d318-4be4-ada7-f51f0818a5ae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:09.348001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] The token cache is being invalidate because project 798cb69ce3864e09b78243635e07b1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:41:09.348298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:09.348931 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-055f0cf5-d318-4be4-ada7-f51f0818a5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:41:09.350421 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1385/2761] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:41:09 2022] DELETE /identity/v3/projects/798cb69ce3864e09b78243635e07b1b5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:41:09.556486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9b66-d0fc-4fbf-a53b-14cf7b9d4e88 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:09.557472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9b66-d0fc-4fbf-a53b-14cf7b9d4e88 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:09.557960 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9b66-d0fc-4fbf-a53b-14cf7b9d4e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:09.592204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-5bed9b66-d0fc-4fbf-a53b-14cf7b9d4e88 None None] MFA Rules not processed for user `569e47572bc440ebb25d217415141e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:09.593550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5bed9b66-d0fc-4fbf-a53b-14cf7b9d4e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:09.668556 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1377/2762] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:41:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:19.344309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:19.659735 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:25.382608 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e529c-ed8c-4a20-a208-c29139edb7a1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:25.383197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e529c-ed8c-4a20-a208-c29139edb7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:25.383197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e529c-ed8c-4a20-a208-c29139edb7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:25.404055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2c6e529c-ed8c-4a20-a208-c29139edb7a1 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:25.405262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c6e529c-ed8c-4a20-a208-c29139edb7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:25.464796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1386/2763] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:25.487315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9b66-d0fc-4fbf-a53b-14cf7b9d4e88 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:25.488719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-5bed9b66-d0fc-4fbf-a53b-14cf7b9d4e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:25.567798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9b66-d0fc-4fbf-a53b-14cf7b9d4e88 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:25.573229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5fd1b-2002-467a-923e-263280000083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:25.573856 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5fd1b-2002-467a-923e-263280000083 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:25.574133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5fd1b-2002-467a-923e-263280000083 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:25.574408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5fd1b-2002-467a-923e-263280000083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:25.582718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5fd1b-2002-467a-923e-263280000083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:25.584301 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5fd1b-2002-467a-923e-263280000083 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:25.593494 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1378/2764] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:28.656036 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbb08c-8838-4890-9eef-94a8fee35b69 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:28.656602 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbb08c-8838-4890-9eef-94a8fee35b69 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:28.656752 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbb08c-8838-4890-9eef-94a8fee35b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:28.676061 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d1fbb08c-8838-4890-9eef-94a8fee35b69 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:28.677242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d1fbb08c-8838-4890-9eef-94a8fee35b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:28.684856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1387/2765] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:28.722276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5fd1b-2002-467a-923e-263280000083 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:28.723677 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6dd5fd1b-2002-467a-923e-263280000083 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:28.738487 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5fd1b-2002-467a-923e-263280000083 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:28.743879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbe0e3-bde2-43a2-abd9-c59527f2747a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:28.744462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe0e3-bde2-43a2-abd9-c59527f2747a service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:28.744739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe0e3-bde2-43a2-abd9-c59527f2747a service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:28.745006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe0e3-bde2-43a2-abd9-c59527f2747a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:28.753687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbe0e3-bde2-43a2-abd9-c59527f2747a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:28.755267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbe0e3-bde2-43a2-abd9-c59527f2747a service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:28.764304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1379/2766] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:31.733117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf762b-b088-4520-8c44-ccae34cabd56 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:31.733670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf762b-b088-4520-8c44-ccae34cabd56 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:31.733670 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf762b-b088-4520-8c44-ccae34cabd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:31.752958 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-76bf762b-b088-4520-8c44-ccae34cabd56 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:31.754143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-76bf762b-b088-4520-8c44-ccae34cabd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:31.761885 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1388/2767] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:31.776870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbe0e3-bde2-43a2-abd9-c59527f2747a service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:31.788448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbe0e3-bde2-43a2-abd9-c59527f2747a service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:31.793839 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd34469-bdc0-454c-9f8c-0495bc7c7ff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:31.794422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd34469-bdc0-454c-9f8c-0495bc7c7ff8 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:31.794729 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd34469-bdc0-454c-9f8c-0495bc7c7ff8 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:31.795001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd34469-bdc0-454c-9f8c-0495bc7c7ff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:31.802972 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd34469-bdc0-454c-9f8c-0495bc7c7ff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:31.804529 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd34469-bdc0-454c-9f8c-0495bc7c7ff8 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:31.813648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1380/2768] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:34.886907 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2585a79-4a1b-4ad1-aa82-62500b35a716 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:34.887379 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2585a79-4a1b-4ad1-aa82-62500b35a716 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:34.887485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2585a79-4a1b-4ad1-aa82-62500b35a716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:34.907160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a2585a79-4a1b-4ad1-aa82-62500b35a716 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:34.908937 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a2585a79-4a1b-4ad1-aa82-62500b35a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:34.916459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1389/2769] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:34.933083 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd34469-bdc0-454c-9f8c-0495bc7c7ff8 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:34.944281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd34469-bdc0-454c-9f8c-0495bc7c7ff8 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:34.949626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff639ee-9964-40c7-bc22-88bf871008e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:34.950210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff639ee-9964-40c7-bc22-88bf871008e6 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:34.950486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff639ee-9964-40c7-bc22-88bf871008e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:34.950795 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff639ee-9964-40c7-bc22-88bf871008e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:34.958627 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff639ee-9964-40c7-bc22-88bf871008e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:34.960345 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff639ee-9964-40c7-bc22-88bf871008e6 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:34.969592 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1381/2770] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:38.059708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e15c-ddf7-4ce7-b901-c54fbb7314e6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:38.060194 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e15c-ddf7-4ce7-b901-c54fbb7314e6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:38.060292 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e15c-ddf7-4ce7-b901-c54fbb7314e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:38.080447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4bb2e15c-ddf7-4ce7-b901-c54fbb7314e6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:38.081882 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4bb2e15c-ddf7-4ce7-b901-c54fbb7314e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:38.089507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1390/2771] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Oct 4 08:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:38.105672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff639ee-9964-40c7-bc22-88bf871008e6 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:38.116554 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff639ee-9964-40c7-bc22-88bf871008e6 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:38.121868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e04f9-1f68-4c8f-80a9-8cd7db517022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c6603b106fa4db58f3d1b5099606ffa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:38.122449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e04f9-1f68-4c8f-80a9-8cd7db517022 service nova] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:38.122754 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e04f9-1f68-4c8f-80a9-8cd7db517022 service nova] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:38.123024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e04f9-1f68-4c8f-80a9-8cd7db517022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:38.131665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e04f9-1f68-4c8f-80a9-8cd7db517022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:38.133219 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e04f9-1f68-4c8f-80a9-8cd7db517022 service nova] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:38.142869 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1382/2772] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:48.074459 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=39 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:48.138263 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=58 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:02.886911 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a03de-b537-4013-a6e2-2acb2d88cb18 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:02.887485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a03de-b537-4013-a6e2-2acb2d88cb18 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:02.887485 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a03de-b537-4013-a6e2-2acb2d88cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:02.907223 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6a0a03de-b537-4013-a6e2-2acb2d88cb18 None None] MFA Rules not processed for user `569e47572bc440ebb25d217415141e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:02.908283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6a0a03de-b537-4013-a6e2-2acb2d88cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:02.914955 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1391/2773] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:42:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:42:07.217424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e04f9-1f68-4c8f-80a9-8cd7db517022 service nova] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:07.218889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ce0e04f9-1f68-4c8f-80a9-8cd7db517022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:07.232375 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e04f9-1f68-4c8f-80a9-8cd7db517022 service nova] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:07.236896 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:07.237521 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:07.237798 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:07.238070 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] PATH_INFO: `/v3/users/09d59ef21d214b6fba670d1449d887f5` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:07.239782 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d59ef21d214b6fba670d1449d887f5)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:07.241683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:07.287031 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d59ef21d214b6fba670d1449d887f5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:42:07.287613 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d59ef21d214b6fba670d1449d887f5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:42:07.301015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d59ef21d214b6fba670d1449d887f5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:42:07.308638 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d59ef21d214b6fba670d1449d887f5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:42:07.309319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d59ef21d214b6fba670d1449d887f5'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:42:07.322019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1383/2774] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:42:07 2022] DELETE /identity/v3/users/09d59ef21d214b6fba670d1449d887f5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:42:07.498403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a03de-b537-4013-a6e2-2acb2d88cb18 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:07.510535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a03de-b537-4013-a6e2-2acb2d88cb18 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:07.578479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:07.579155 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:07.579507 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:07.579852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] PATH_INFO: `/v3/projects/bf4cf7ed33c4452d9f11edf58d8e46f0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:07.581058 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4cf7ed33c4452d9f11edf58d8e46f0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:07.583103 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:07.631270 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4cf7ed33c4452d9f11edf58d8e46f0', 'request_id': 'req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:42:07.637008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4cf7ed33c4452d9f11edf58d8e46f0', 'request_id': 'req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:42:07.643116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4cf7ed33c4452d9f11edf58d8e46f0', 'request_id': 'req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:42:07.656784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] The token cache is being invalidate because project bf4cf7ed33c4452d9f11edf58d8e46f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:42:07.657075 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:42:07.657698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:42:07.659226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1392/2775] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:42:07 2022] DELETE /identity/v3/projects/bf4cf7ed33c4452d9f11edf58d8e46f0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:17.318593 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:17.653723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:53.475121 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.476611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:53.620461 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b81ff-3afe-439d-90f1-a2350410d2d3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:53.682604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424db91-2aa2-4f03-8382-e2d0e5fd2df5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4030325cf0481ab634e253cfed9c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:53.683243 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424db91-2aa2-4f03-8382-e2d0e5fd2df5 service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.684163 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424db91-2aa2-4f03-8382-e2d0e5fd2df5 service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.684446 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424db91-2aa2-4f03-8382-e2d0e5fd2df5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.686187 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3424db91-2aa2-4f03-8382-e2d0e5fd2df5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:53.697703 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424db91-2aa2-4f03-8382-e2d0e5fd2df5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:53.699319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424db91-2aa2-4f03-8382-e2d0e5fd2df5 service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:53.711603 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1384/2776] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:42:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:42:54.295736 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:54.297528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:54.402699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fb675-922d-466b-ad8b-7eb4ec7fe9d8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:54.408684 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69212c-d685-4805-92d8-ddf91a03608c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:54.409524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69212c-d685-4805-92d8-ddf91a03608c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:54.409808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69212c-d685-4805-92d8-ddf91a03608c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:54.410085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69212c-d685-4805-92d8-ddf91a03608c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:54.412811 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4b69212c-d685-4805-92d8-ddf91a03608c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:54.426306 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69212c-d685-4805-92d8-ddf91a03608c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:54.428673 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69212c-d685-4805-92d8-ddf91a03608c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:54.440245 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1393/2777] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:42:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:42:54.540694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424db91-2aa2-4f03-8382-e2d0e5fd2df5 service placement] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:54.551214 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424db91-2aa2-4f03-8382-e2d0e5fd2df5 service placement] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:54.555670 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077cdb0-58de-41f4-bef9-3f5bd9820a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:54.556280 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077cdb0-58de-41f4-bef9-3f5bd9820a00 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:54.556562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077cdb0-58de-41f4-bef9-3f5bd9820a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:54.556830 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077cdb0-58de-41f4-bef9-3f5bd9820a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:54.558996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6077cdb0-58de-41f4-bef9-3f5bd9820a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:54.584127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=100 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:54.663028 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077cdb0-58de-41f4-bef9-3f5bd9820a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:54.665097 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077cdb0-58de-41f4-bef9-3f5bd9820a00 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:54.686724 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1385/2778] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:42:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:43:04.065101 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff26d02-ccd9-4f9e-b6e1-2148be9103f8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:04.065627 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff26d02-ccd9-4f9e-b6e1-2148be9103f8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:04.065737 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff26d02-ccd9-4f9e-b6e1-2148be9103f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:04.086403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4ff26d02-ccd9-4f9e-b6e1-2148be9103f8 None None] MFA Rules not processed for user `569e47572bc440ebb25d217415141e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:04.087687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4ff26d02-ccd9-4f9e-b6e1-2148be9103f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:04.141779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1394/2779] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:43:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:04.684027 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=35 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:14.135319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=53 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:03.764719 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9edb6-d93f-45e2-bb86-4b1b4e881f7a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:03.765281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9edb6-d93f-45e2-bb86-4b1b4e881f7a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:03.765281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9edb6-d93f-45e2-bb86-4b1b4e881f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:03.784681 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2bc9edb6-d93f-45e2-bb86-4b1b4e881f7a None None] MFA Rules not processed for user `569e47572bc440ebb25d217415141e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:03.785871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2bc9edb6-d93f-45e2-bb86-4b1b4e881f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:03.793128 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1386/2780] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:44:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:04.088612 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff26d02-ccd9-4f9e-b6e1-2148be9103f8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.107326 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff26d02-ccd9-4f9e-b6e1-2148be9103f8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.110895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906a10b-a2f2-4153-815b-2fecda9dfab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.111493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906a10b-a2f2-4153-815b-2fecda9dfab5 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.111769 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906a10b-a2f2-4153-815b-2fecda9dfab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.112038 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906a10b-a2f2-4153-815b-2fecda9dfab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.113750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3906a10b-a2f2-4153-815b-2fecda9dfab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:04.136374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906a10b-a2f2-4153-815b-2fecda9dfab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:04.137806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906a10b-a2f2-4153-815b-2fecda9dfab5 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:04.145924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1395/2781] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:13.779229 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:14.142259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=15 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:23.109957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9edb6-d93f-45e2-bb86-4b1b4e881f7a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:23.112006 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2bc9edb6-d93f-45e2-bb86-4b1b4e881f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:23.135129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9edb6-d93f-45e2-bb86-4b1b4e881f7a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:23.142612 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fcf5-ed52-4052-b649-83b2a4fe9131 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4030325cf0481ab634e253cfed9c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:23.143701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fcf5-ed52-4052-b649-83b2a4fe9131 service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:23.144173 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fcf5-ed52-4052-b649-83b2a4fe9131 service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:23.145164 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fcf5-ed52-4052-b649-83b2a4fe9131 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:23.147647 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-0ec7fcf5-ed52-4052-b649-83b2a4fe9131 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:23.165973 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7fcf5-ed52-4052-b649-83b2a4fe9131 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:23.168478 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7fcf5-ed52-4052-b649-83b2a4fe9131 service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:23.213302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1387/2782] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:26.060047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906a10b-a2f2-4153-815b-2fecda9dfab5 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:26.061618 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3906a10b-a2f2-4153-815b-2fecda9dfab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:26.157328 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906a10b-a2f2-4153-815b-2fecda9dfab5 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:26.162021 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:26.162724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:26.163008 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:26.163294 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] PATH_INFO: `/v3/users/0ecdf8d355ca48d68275939352863294` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:26.164932 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ecdf8d355ca48d68275939352863294)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:26.166976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:26.212013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ecdf8d355ca48d68275939352863294'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.212659 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ecdf8d355ca48d68275939352863294'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.219464 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ecdf8d355ca48d68275939352863294'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.220088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ecdf8d355ca48d68275939352863294'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.233158 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ecdf8d355ca48d68275939352863294'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.245651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1396/2783] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:44:26 2022] DELETE /identity/v3/users/0ecdf8d355ca48d68275939352863294 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:44:26.415337 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fcf5-ed52-4052-b649-83b2a4fe9131 service placement] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:26.426253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fcf5-ed52-4052-b649-83b2a4fe9131 service placement] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:26.492004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:26.493224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:26.493224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:26.493725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] PATH_INFO: `/v3/projects/fd2f06d8aa5d442d9154b75383100fcf` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:26.494884 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2f06d8aa5d442d9154b75383100fcf)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:26.496751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:26.542410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2f06d8aa5d442d9154b75383100fcf', 'request_id': 'req-9895d501-3b9c-4200-90f9-ca89e40b2b41'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.548572 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2f06d8aa5d442d9154b75383100fcf', 'request_id': 'req-9895d501-3b9c-4200-90f9-ca89e40b2b41'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.554077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2f06d8aa5d442d9154b75383100fcf', 'request_id': 'req-9895d501-3b9c-4200-90f9-ca89e40b2b41'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.567626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] The token cache is being invalidate because project fd2f06d8aa5d442d9154b75383100fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:44:26.567906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.568516 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.569970 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1388/2784] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:44:26 2022] DELETE /identity/v3/projects/fd2f06d8aa5d442d9154b75383100fcf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:44:26.574794 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:26.576234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:26.590875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07562203-2564-415f-8b89-9ea1b3bed7b6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:26.639935 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:26.652466 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:26.653222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:26.653487 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:26.653759 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] PATH_INFO: `/v3/users/358be4e2f12e46e3b02f357544f04ac0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:26.654910 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=358be4e2f12e46e3b02f357544f04ac0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:26.656911 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:26.702422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358be4e2f12e46e3b02f357544f04ac0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.703170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358be4e2f12e46e3b02f357544f04ac0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.710291 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358be4e2f12e46e3b02f357544f04ac0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.710965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358be4e2f12e46e3b02f357544f04ac0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.723591 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358be4e2f12e46e3b02f357544f04ac0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:26.743091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1397/2785] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:44:26 2022] DELETE /identity/v3/users/358be4e2f12e46e3b02f357544f04ac0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:44:26.912498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:26.914012 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:26.928024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895d501-3b9c-4200-90f9-ca89e40b2b41 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:26.985996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:26.986624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:26.986935 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:26.987209 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] PATH_INFO: `/v3/projects/1f46aa108a524cc29c09ba8c9e7ef228` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:26.988321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f46aa108a524cc29c09ba8c9e7ef228)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:26.990215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:27.010642 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:27.038283 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f46aa108a524cc29c09ba8c9e7ef228', 'request_id': 'req-cc6ab34d-3697-4acc-9d79-a4ce1456389c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:27.044208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f46aa108a524cc29c09ba8c9e7ef228', 'request_id': 'req-cc6ab34d-3697-4acc-9d79-a4ce1456389c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:27.049538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f46aa108a524cc29c09ba8c9e7ef228', 'request_id': 'req-cc6ab34d-3697-4acc-9d79-a4ce1456389c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:27.065089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] The token cache is being invalidate because project 1f46aa108a524cc29c09ba8c9e7ef228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:44:27.065405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:27.066084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:44:27.067889 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1389/2786] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:44:26 2022] DELETE /identity/v3/projects/1f46aa108a524cc29c09ba8c9e7ef228 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:44:36.736259 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:37.060567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:56.984364 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:56.985561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:57.064863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680146fb-d09f-4a6a-b3fb-25e964efb7ec admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:57.111647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd8b1-4ae0-416e-b8d7-bd2b84d15569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:57.112241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd8b1-4ae0-416e-b8d7-bd2b84d15569 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:57.112540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd8b1-4ae0-416e-b8d7-bd2b84d15569 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:57.112808 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd8b1-4ae0-416e-b8d7-bd2b84d15569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:57.114511 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-af3cd8b1-4ae0-416e-b8d7-bd2b84d15569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:57.184822 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cd8b1-4ae0-416e-b8d7-bd2b84d15569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:57.186261 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cd8b1-4ae0-416e-b8d7-bd2b84d15569 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:57.197247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1398/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:58.757488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:58.759815 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:58.772176 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ab34d-3697-4acc-9d79-a4ce1456389c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:58.775730 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab6979-cc74-47a1-b67c-aaa270724377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:58.776321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab6979-cc74-47a1-b67c-aaa270724377 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:58.776599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab6979-cc74-47a1-b67c-aaa270724377 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:58.776870 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab6979-cc74-47a1-b67c-aaa270724377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:58.778547 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-abab6979-cc74-47a1-b67c-aaa270724377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:58.792476 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab6979-cc74-47a1-b67c-aaa270724377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:58.793900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab6979-cc74-47a1-b67c-aaa270724377 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:58.804687 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1390/2788] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:07.192470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=83 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:08.799877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=6 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:11.121272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd8b1-4ae0-416e-b8d7-bd2b84d15569 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:11.122889 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-af3cd8b1-4ae0-416e-b8d7-bd2b84d15569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:11.200333 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd8b1-4ae0-416e-b8d7-bd2b84d15569 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:11.205762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:11.206392 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.206739 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.206973 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] PATH_INFO: `/v3/users/569e47572bc440ebb25d217415141e6d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.208121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=569e47572bc440ebb25d217415141e6d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:11.210227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:11.257227 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569e47572bc440ebb25d217415141e6d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:11.258208 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569e47572bc440ebb25d217415141e6d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:11.264997 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569e47572bc440ebb25d217415141e6d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:11.265611 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569e47572bc440ebb25d217415141e6d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:11.277055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c0806e15-9727-40d2-8166-483410666b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569e47572bc440ebb25d217415141e6d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:11.289545 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1399/2789] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:11 2022] DELETE /identity/v3/users/569e47572bc440ebb25d217415141e6d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:11.465484 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab6979-cc74-47a1-b67c-aaa270724377 service cinder] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:11.481153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab6979-cc74-47a1-b67c-aaa270724377 service cinder] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:11.539486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:11.540602 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.540887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.541161 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] PATH_INFO: `/v3/projects/57241696da8a4f9a887d693d9f281661` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.542355 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57241696da8a4f9a887d693d9f281661)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:11.544294 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:11.591522 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57241696da8a4f9a887d693d9f281661', 'request_id': 'req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:11.597768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57241696da8a4f9a887d693d9f281661', 'request_id': 'req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:11.604011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57241696da8a4f9a887d693d9f281661', 'request_id': 'req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:11.615980 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] The token cache is being invalidate because project 57241696da8a4f9a887d693d9f281661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:11.616267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:11.616877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-bbdc6261-3cc4-4a8a-a5f7-a781e4d2d696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:11.618377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1391/2790] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:11 2022] DELETE /identity/v3/projects/57241696da8a4f9a887d693d9f281661 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:11.623264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50537-2e1b-41ad-b4b1-b567e144ed21 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.623551 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50537-2e1b-41ad-b4b1-b567e144ed21 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.623823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50537-2e1b-41ad-b4b1-b567e144ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.681353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dea50537-2e1b-41ad-b4b1-b567e144ed21 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:11.682540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dea50537-2e1b-41ad-b4b1-b567e144ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:11.724441 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:11.739985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1400/2791] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:11.748332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc3b23-63a0-425f-ac2a-86a73d378815 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.748617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc3b23-63a0-425f-ac2a-86a73d378815 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.748890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc3b23-63a0-425f-ac2a-86a73d378815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.769144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-67bc3b23-63a0-425f-ac2a-86a73d378815 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:11.770363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-67bc3b23-63a0-425f-ac2a-86a73d378815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:11.779341 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1392/2792] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:11.783903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50537-2e1b-41ad-b4b1-b567e144ed21 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:11.794148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50537-2e1b-41ad-b4b1-b567e144ed21 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:11.798785 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f8a6b-5375-4190-8ce2-c8754de4cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:11.799398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f8a6b-5375-4190-8ce2-c8754de4cfdf admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.799673 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f8a6b-5375-4190-8ce2-c8754de4cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.799940 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f8a6b-5375-4190-8ce2-c8754de4cfdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.800601 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f8a6b-5375-4190-8ce2-c8754de4cfdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:11.800900 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f8a6b-5375-4190-8ce2-c8754de4cfdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:11.802508 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f8a6b-5375-4190-8ce2-c8754de4cfdf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:11.814546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1401/2793] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:11.818881 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc3b23-63a0-425f-ac2a-86a73d378815 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:11.828321 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc3b23-63a0-425f-ac2a-86a73d378815 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:11.832874 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf57e80-89c8-4618-a62c-f25aa305f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:11.833455 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf57e80-89c8-4618-a62c-f25aa305f9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.833728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf57e80-89c8-4618-a62c-f25aa305f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.833996 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf57e80-89c8-4618-a62c-f25aa305f9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.834619 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf57e80-89c8-4618-a62c-f25aa305f9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:11.836718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf57e80-89c8-4618-a62c-f25aa305f9e5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:11.872464 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1393/2794] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:11 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:11.876546 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f8a6b-5375-4190-8ce2-c8754de4cfdf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:11.886461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f8a6b-5375-4190-8ce2-c8754de4cfdf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:11.940488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467937c2-4ed0-42ec-85aa-cb8973451a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:11.941079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467937c2-4ed0-42ec-85aa-cb8973451a92 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.941358 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467937c2-4ed0-42ec-85aa-cb8973451a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.941623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467937c2-4ed0-42ec-85aa-cb8973451a92 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.942241 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467937c2-4ed0-42ec-85aa-cb8973451a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:11.944164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467937c2-4ed0-42ec-85aa-cb8973451a92 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:11.964548 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1402/2795] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:11 2022] POST /identity/v3/users => generated 303 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:11.968685 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf57e80-89c8-4618-a62c-f25aa305f9e5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:11.980466 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf57e80-89c8-4618-a62c-f25aa305f9e5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:11.984995 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c1f4a-cef2-4537-a274-072a4a952551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:11.985583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c1f4a-cef2-4537-a274-072a4a952551 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.985857 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c1f4a-cef2-4537-a274-072a4a952551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.986125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c1f4a-cef2-4537-a274-072a4a952551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.986875 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c1f4a-cef2-4537-a274-072a4a952551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:11.988447 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c1f4a-cef2-4537-a274-072a4a952551 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:11.999184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1394/2796] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:45:12.002920 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467937c2-4ed0-42ec-85aa-cb8973451a92 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:12.012773 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467937c2-4ed0-42ec-85aa-cb8973451a92 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:12.017539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad848b9-a500-4ab8-bd35-4a78d99422f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:12.018125 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad848b9-a500-4ab8-bd35-4a78d99422f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:12.018400 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad848b9-a500-4ab8-bd35-4a78d99422f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:12.018689 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad848b9-a500-4ab8-bd35-4a78d99422f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:12.019330 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad848b9-a500-4ab8-bd35-4a78d99422f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:12.020926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad848b9-a500-4ab8-bd35-4a78d99422f4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:12.031121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1403/2797] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:12.035084 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c1f4a-cef2-4537-a274-072a4a952551 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:12.045673 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c1f4a-cef2-4537-a274-072a4a952551 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:12.050316 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567e7fb-7193-4158-b744-bdf66c88f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:12.050991 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e7fb-7193-4158-b744-bdf66c88f133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:12.051272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e7fb-7193-4158-b744-bdf66c88f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:12.051543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e7fb-7193-4158-b744-bdf66c88f133 admin admin] PATH_INFO: `/v3/projects/5592d060d15f4ca38360f3e48c008d2c/users/f06f001f53634227b69a978645d37cea/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:12.065820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567e7fb-7193-4158-b744-bdf66c88f133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5592d060d15f4ca38360f3e48c008d2c, user_id=f06f001f53634227b69a978645d37cea, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:12.068520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567e7fb-7193-4158-b744-bdf66c88f133 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:12.081923 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1395/2798] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:12 2022] PUT /identity/v3/projects/5592d060d15f4ca38360f3e48c008d2c/users/f06f001f53634227b69a978645d37cea/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:12.087688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2f83-b8f4-423d-b4c1-d0966a82a482 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:12.087972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2f83-b8f4-423d-b4c1-d0966a82a482 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:12.088240 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2f83-b8f4-423d-b4c1-d0966a82a482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:12.106498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4f8a2f83-b8f4-423d-b4c1-d0966a82a482 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:12.107715 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f8a2f83-b8f4-423d-b4c1-d0966a82a482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:12.164827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1404/2799] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:12.174457 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567e7fb-7193-4158-b744-bdf66c88f133 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:12.176172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f567e7fb-7193-4158-b744-bdf66c88f133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:12.197583 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:12.235358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567e7fb-7193-4158-b744-bdf66c88f133 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:12.239024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c351e-1ecd-440d-9d02-5a2ab0e85474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:12.239621 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c351e-1ecd-440d-9d02-5a2ab0e85474 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:12.239901 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c351e-1ecd-440d-9d02-5a2ab0e85474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:12.240172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c351e-1ecd-440d-9d02-5a2ab0e85474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:12.250072 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c351e-1ecd-440d-9d02-5a2ab0e85474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:12.251533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c351e-1ecd-440d-9d02-5a2ab0e85474 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:12.261544 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1396/2800] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:12.866630 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22bdd-fd66-4d33-9c7d-6bcaace520de None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:12.867587 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22bdd-fd66-4d33-9c7d-6bcaace520de None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:12.868493 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22bdd-fd66-4d33-9c7d-6bcaace520de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:12.897447 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-31a22bdd-fd66-4d33-9c7d-6bcaace520de None None] MFA Rules not processed for user `f06f001f53634227b69a978645d37cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:12.899890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-31a22bdd-fd66-4d33-9c7d-6bcaace520de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:12.943933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:12.966695 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1405/2801] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:12.971286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c351e-1ecd-440d-9d02-5a2ab0e85474 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:12.980949 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c351e-1ecd-440d-9d02-5a2ab0e85474 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:12.985596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e20f6-579c-410f-bebd-c2d08455ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:12.986184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e20f6-579c-410f-bebd-c2d08455ef5a admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:12.986462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e20f6-579c-410f-bebd-c2d08455ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:12.986763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e20f6-579c-410f-bebd-c2d08455ef5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:12.987398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e20f6-579c-410f-bebd-c2d08455ef5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:12.989276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e20f6-579c-410f-bebd-c2d08455ef5a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:13.018558 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1397/2802] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:12 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:13.022655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a22bdd-fd66-4d33-9c7d-6bcaace520de None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:13.033771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a22bdd-fd66-4d33-9c7d-6bcaace520de None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:13.090177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4929d-2574-459d-8ed7-056e6533ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:13.090817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4929d-2574-459d-8ed7-056e6533ecf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.091099 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4929d-2574-459d-8ed7-056e6533ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.091375 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4929d-2574-459d-8ed7-056e6533ecf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.092001 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4929d-2574-459d-8ed7-056e6533ecf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:13.093913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4929d-2574-459d-8ed7-056e6533ecf9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:13.116054 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1406/2803] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:13 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:45:13.120127 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e20f6-579c-410f-bebd-c2d08455ef5a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:13.130558 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e20f6-579c-410f-bebd-c2d08455ef5a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:13.135293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d56aac-e4c9-4c62-af51-d6dc2f922b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:13.135887 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56aac-e4c9-4c62-af51-d6dc2f922b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.136170 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56aac-e4c9-4c62-af51-d6dc2f922b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.136439 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56aac-e4c9-4c62-af51-d6dc2f922b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.137111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d56aac-e4c9-4c62-af51-d6dc2f922b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:13.138713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d56aac-e4c9-4c62-af51-d6dc2f922b7f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:13.151029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1398/2804] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:13.155182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4929d-2574-459d-8ed7-056e6533ecf9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:13.165607 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4929d-2574-459d-8ed7-056e6533ecf9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:13.170273 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa6449-8d16-40a1-b363-d3725cce838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:13.171174 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa6449-8d16-40a1-b363-d3725cce838e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.171461 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa6449-8d16-40a1-b363-d3725cce838e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.171733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa6449-8d16-40a1-b363-d3725cce838e admin admin] PATH_INFO: `/v3/projects/aaa69c67854c4240ab99ebcbf0a36fca/users/8f951da8cd024628bfc3b3769920c59f/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.186007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa6449-8d16-40a1-b363-d3725cce838e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa69c67854c4240ab99ebcbf0a36fca, user_id=8f951da8cd024628bfc3b3769920c59f, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:13.188987 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa6449-8d16-40a1-b363-d3725cce838e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:13.201383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1407/2805] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:13 2022] PUT /identity/v3/projects/aaa69c67854c4240ab99ebcbf0a36fca/users/8f951da8cd024628bfc3b3769920c59f/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:13.205269 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d56aac-e4c9-4c62-af51-d6dc2f922b7f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:13.218057 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d56aac-e4c9-4c62-af51-d6dc2f922b7f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:13.274467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb5b81-9c59-421a-a3db-748c9540d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:13.275038 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb5b81-9c59-421a-a3db-748c9540d4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.275319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb5b81-9c59-421a-a3db-748c9540d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.275591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb5b81-9c59-421a-a3db-748c9540d4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.276232 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb5b81-9c59-421a-a3db-748c9540d4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:13.277822 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb5b81-9c59-421a-a3db-748c9540d4c1 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:13.287346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1399/2806] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:13.291634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa6449-8d16-40a1-b363-d3725cce838e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:13.301779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa6449-8d16-40a1-b363-d3725cce838e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:13.306443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca452b-4634-4657-b348-4d2751e195f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:13.307121 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca452b-4634-4657-b348-4d2751e195f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.307406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca452b-4634-4657-b348-4d2751e195f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.307699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca452b-4634-4657-b348-4d2751e195f4 admin admin] PATH_INFO: `/v3/projects/aaa69c67854c4240ab99ebcbf0a36fca/users/8f951da8cd024628bfc3b3769920c59f/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.310011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca452b-4634-4657-b348-4d2751e195f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa69c67854c4240ab99ebcbf0a36fca, user_id=8f951da8cd024628bfc3b3769920c59f, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:13.313436 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca452b-4634-4657-b348-4d2751e195f4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:13.324059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1408/2807] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:13 2022] PUT /identity/v3/projects/aaa69c67854c4240ab99ebcbf0a36fca/users/8f951da8cd024628bfc3b3769920c59f/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:14.180133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4a0fd-bbad-4b36-8e23-dd7b41f0f733 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:14.181330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4a0fd-bbad-4b36-8e23-dd7b41f0f733 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:14.181563 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4a0fd-bbad-4b36-8e23-dd7b41f0f733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:14.208401 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6fb4a0fd-bbad-4b36-8e23-dd7b41f0f733 None None] MFA Rules not processed for user `8f951da8cd024628bfc3b3769920c59f`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:14.209606 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6fb4a0fd-bbad-4b36-8e23-dd7b41f0f733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:14.277645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1400/2808] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:15.307716 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca452b-4634-4657-b348-4d2751e195f4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:15.376647 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca452b-4634-4657-b348-4d2751e195f4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:15.381371 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:15.382028 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:15.382311 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:15.383059 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] PATH_INFO: `/v3/users/f06f001f53634227b69a978645d37cea` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:15.384197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06f001f53634227b69a978645d37cea)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:15.386119 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:15.426874 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:15.434501 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06f001f53634227b69a978645d37cea'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.435148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06f001f53634227b69a978645d37cea'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.442057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06f001f53634227b69a978645d37cea'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.442700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06f001f53634227b69a978645d37cea'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.454598 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06f001f53634227b69a978645d37cea'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.468728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1409/2809] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:15 2022] DELETE /identity/v3/users/f06f001f53634227b69a978645d37cea => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:15.643659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4a0fd-bbad-4b36-8e23-dd7b41f0f733 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:15.655701 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4a0fd-bbad-4b36-8e23-dd7b41f0f733 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:15.660596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:15.714184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:15.714763 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:15.715046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:15.715309 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] PATH_INFO: `/v3/projects/5592d060d15f4ca38360f3e48c008d2c` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:15.716407 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5592d060d15f4ca38360f3e48c008d2c)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:15.718272 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:15.762728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5592d060d15f4ca38360f3e48c008d2c', 'request_id': 'req-18110927-4686-4d0c-805f-832057e40e6c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.769015 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5592d060d15f4ca38360f3e48c008d2c', 'request_id': 'req-18110927-4686-4d0c-805f-832057e40e6c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.775722 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5592d060d15f4ca38360f3e48c008d2c', 'request_id': 'req-18110927-4686-4d0c-805f-832057e40e6c'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.788244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] The token cache is being invalidate because project 5592d060d15f4ca38360f3e48c008d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:15.788629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.789375 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.791061 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1401/2810] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:15 2022] DELETE /identity/v3/projects/5592d060d15f4ca38360f3e48c008d2c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:15.795085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:15.796579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:15.809353 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9648c-ae12-46d4-abe2-c313ea34418e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:15.864307 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:15.864926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:15.865204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:15.865474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] PATH_INFO: `/v3/users/8f951da8cd024628bfc3b3769920c59f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:15.866582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f951da8cd024628bfc3b3769920c59f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:15.868524 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:15.918057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f951da8cd024628bfc3b3769920c59f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.918723 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f951da8cd024628bfc3b3769920c59f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.925474 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f951da8cd024628bfc3b3769920c59f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.926093 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f951da8cd024628bfc3b3769920c59f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.938045 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7d4b0b09-7275-4fc9-8735-46211e8de428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f951da8cd024628bfc3b3769920c59f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:15.951699 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1410/2811] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:15 2022] DELETE /identity/v3/users/8f951da8cd024628bfc3b3769920c59f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:16.118931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.120470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:16.138000 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18110927-4686-4d0c-805f-832057e40e6c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.196595 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.197221 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.197498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.197771 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] PATH_INFO: `/v3/projects/aaa69c67854c4240ab99ebcbf0a36fca` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.198915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa69c67854c4240ab99ebcbf0a36fca)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.200806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:16.240933 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:16.249568 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa69c67854c4240ab99ebcbf0a36fca', 'request_id': 'req-580a8daa-7b29-45a2-b697-8c65146c2f17'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:16.255726 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa69c67854c4240ab99ebcbf0a36fca', 'request_id': 'req-580a8daa-7b29-45a2-b697-8c65146c2f17'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:16.262183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa69c67854c4240ab99ebcbf0a36fca', 'request_id': 'req-580a8daa-7b29-45a2-b697-8c65146c2f17'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:16.274550 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] The token cache is being invalidate because project aaa69c67854c4240ab99ebcbf0a36fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:16.274885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:16.275499 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-580a8daa-7b29-45a2-b697-8c65146c2f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:16.277198 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1402/2812] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:16 2022] DELETE /identity/v3/projects/aaa69c67854c4240ab99ebcbf0a36fca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:45:16.282318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77734d-634b-40c8-ac62-23c9b21d42fc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.282606 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77734d-634b-40c8-ac62-23c9b21d42fc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.282917 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77734d-634b-40c8-ac62-23c9b21d42fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.302528 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8e77734d-634b-40c8-ac62-23c9b21d42fc None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:16.303750 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8e77734d-634b-40c8-ac62-23c9b21d42fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:16.334694 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:16.365708 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1411/2813] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:16.375496 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560354b-d3b7-4e0e-846c-65db2c63f5a9 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.375779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560354b-d3b7-4e0e-846c-65db2c63f5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.376052 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560354b-d3b7-4e0e-846c-65db2c63f5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.395346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-3560354b-d3b7-4e0e-846c-65db2c63f5a9 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:16.396533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-3560354b-d3b7-4e0e-846c-65db2c63f5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:16.404493 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1403/2814] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:16.408666 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77734d-634b-40c8-ac62-23c9b21d42fc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.418700 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77734d-634b-40c8-ac62-23c9b21d42fc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.423186 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021a18-0cc1-44cb-ad64-53dfef30634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.423775 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021a18-0cc1-44cb-ad64-53dfef30634c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.424055 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021a18-0cc1-44cb-ad64-53dfef30634c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.424332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021a18-0cc1-44cb-ad64-53dfef30634c admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.424969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021a18-0cc1-44cb-ad64-53dfef30634c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:16.425277 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021a18-0cc1-44cb-ad64-53dfef30634c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.426926 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021a18-0cc1-44cb-ad64-53dfef30634c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:16.439439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1412/2815] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:16.443574 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560354b-d3b7-4e0e-846c-65db2c63f5a9 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.452567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560354b-d3b7-4e0e-846c-65db2c63f5a9 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.457322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999158e-9d55-463c-b89a-e4a6f504e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.457919 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999158e-9d55-463c-b89a-e4a6f504e976 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.458197 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999158e-9d55-463c-b89a-e4a6f504e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.458469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999158e-9d55-463c-b89a-e4a6f504e976 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.459129 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999158e-9d55-463c-b89a-e4a6f504e976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.461166 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999158e-9d55-463c-b89a-e4a6f504e976 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:16.488725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1404/2816] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:16 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:16.493503 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021a18-0cc1-44cb-ad64-53dfef30634c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.503480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021a18-0cc1-44cb-ad64-53dfef30634c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.557985 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53cbcc-1273-4e22-92f3-0b2b70f6a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.558579 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53cbcc-1273-4e22-92f3-0b2b70f6a208 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.558886 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53cbcc-1273-4e22-92f3-0b2b70f6a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.559157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53cbcc-1273-4e22-92f3-0b2b70f6a208 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.559779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53cbcc-1273-4e22-92f3-0b2b70f6a208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.561687 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53cbcc-1273-4e22-92f3-0b2b70f6a208 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:16.582298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1413/2817] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:16 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:16.586707 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999158e-9d55-463c-b89a-e4a6f504e976 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.597897 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999158e-9d55-463c-b89a-e4a6f504e976 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.604720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e46c52-b3d9-45be-b3fb-df850bee10f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.605403 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e46c52-b3d9-45be-b3fb-df850bee10f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.605764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e46c52-b3d9-45be-b3fb-df850bee10f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.606054 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e46c52-b3d9-45be-b3fb-df850bee10f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.606848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e46c52-b3d9-45be-b3fb-df850bee10f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.608696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e46c52-b3d9-45be-b3fb-df850bee10f5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:16.620046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1405/2818] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:45:16.624037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53cbcc-1273-4e22-92f3-0b2b70f6a208 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.634159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53cbcc-1273-4e22-92f3-0b2b70f6a208 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.638946 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7874e-0dcd-4c12-9cb1-d16fa848ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.639798 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7874e-0dcd-4c12-9cb1-d16fa848ad95 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.640076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7874e-0dcd-4c12-9cb1-d16fa848ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.640345 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7874e-0dcd-4c12-9cb1-d16fa848ad95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.640981 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7874e-0dcd-4c12-9cb1-d16fa848ad95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.642566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7874e-0dcd-4c12-9cb1-d16fa848ad95 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:16.654784 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1414/2819] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:45:16.658873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e46c52-b3d9-45be-b3fb-df850bee10f5 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.669391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e46c52-b3d9-45be-b3fb-df850bee10f5 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.673907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7addc-b562-4602-984e-72cc43a9c262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.674543 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7addc-b562-4602-984e-72cc43a9c262 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.674864 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7addc-b562-4602-984e-72cc43a9c262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.675153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7addc-b562-4602-984e-72cc43a9c262 admin admin] PATH_INFO: `/v3/projects/8bfd35a7972d41d59e5b30be768a53bb/users/e324ce76f1124a53a01c23558202b3a8/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.689347 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7addc-b562-4602-984e-72cc43a9c262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfd35a7972d41d59e5b30be768a53bb, user_id=e324ce76f1124a53a01c23558202b3a8, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.692253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7addc-b562-4602-984e-72cc43a9c262 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:16.704885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1406/2820] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:16 2022] PUT /identity/v3/projects/8bfd35a7972d41d59e5b30be768a53bb/users/e324ce76f1124a53a01c23558202b3a8/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:45:16.715796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da144a-4ff8-4547-af66-52a3cb2204ad None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.716081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da144a-4ff8-4547-af66-52a3cb2204ad None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.716356 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da144a-4ff8-4547-af66-52a3cb2204ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.744025 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-88da144a-4ff8-4547-af66-52a3cb2204ad None None] MFA Rules not processed for user `e324ce76f1124a53a01c23558202b3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:16.745226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-88da144a-4ff8-4547-af66-52a3cb2204ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:16.810661 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1415/2821] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:16.815247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7addc-b562-4602-984e-72cc43a9c262 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.875436 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7addc-b562-4602-984e-72cc43a9c262 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.880048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa1546-62e5-4cea-8262-33372f23339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.880644 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa1546-62e5-4cea-8262-33372f23339e admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.880922 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa1546-62e5-4cea-8262-33372f23339e admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.881196 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa1546-62e5-4cea-8262-33372f23339e admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.881829 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa1546-62e5-4cea-8262-33372f23339e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.885244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa1546-62e5-4cea-8262-33372f23339e admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:16.911175 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1407/2822] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:16 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:16.915657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da144a-4ff8-4547-af66-52a3cb2204ad None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.926072 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da144a-4ff8-4547-af66-52a3cb2204ad None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.954340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:16.982168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edb0f-e375-41c8-a38d-d0429be6d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.982929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edb0f-e375-41c8-a38d-d0429be6d7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.983207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edb0f-e375-41c8-a38d-d0429be6d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.983480 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edb0f-e375-41c8-a38d-d0429be6d7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.984113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184edb0f-e375-41c8-a38d-d0429be6d7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.986023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184edb0f-e375-41c8-a38d-d0429be6d7b7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:17.008840 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1416/2823] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:16 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:17.013034 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa1546-62e5-4cea-8262-33372f23339e admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:17.024167 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa1546-62e5-4cea-8262-33372f23339e admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:17.028767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a4bb9-4aba-46f9-8b86-d9c00362ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:17.029363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a4bb9-4aba-46f9-8b86-d9c00362ebcc admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:17.029645 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a4bb9-4aba-46f9-8b86-d9c00362ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:17.029927 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a4bb9-4aba-46f9-8b86-d9c00362ebcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:17.030575 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a4bb9-4aba-46f9-8b86-d9c00362ebcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:17.032208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a4bb9-4aba-46f9-8b86-d9c00362ebcc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:17.044205 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1408/2824] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:17.048381 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edb0f-e375-41c8-a38d-d0429be6d7b7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:17.059081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edb0f-e375-41c8-a38d-d0429be6d7b7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:17.063629 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85575-9438-46cb-9a2b-4212b28251ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:17.064320 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85575-9438-46cb-9a2b-4212b28251ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:17.064600 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85575-9438-46cb-9a2b-4212b28251ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:17.064875 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85575-9438-46cb-9a2b-4212b28251ac admin admin] PATH_INFO: `/v3/projects/2ae938e9b258456989f0397f62ba24e0/users/d6c3ea1ff5bf437c8c695c409cf2f652/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:17.079860 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85575-9438-46cb-9a2b-4212b28251ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae938e9b258456989f0397f62ba24e0, user_id=d6c3ea1ff5bf437c8c695c409cf2f652, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:17.082479 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85575-9438-46cb-9a2b-4212b28251ac admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:17.095799 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1417/2825] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:17 2022] PUT /identity/v3/projects/2ae938e9b258456989f0397f62ba24e0/users/d6c3ea1ff5bf437c8c695c409cf2f652/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:17.099752 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a4bb9-4aba-46f9-8b86-d9c00362ebcc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:17.109924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a4bb9-4aba-46f9-8b86-d9c00362ebcc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:17.146597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:17.168672 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b03bc-337d-4fc5-afe7-85910f7dae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:17.169257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b03bc-337d-4fc5-afe7-85910f7dae97 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:17.169536 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b03bc-337d-4fc5-afe7-85910f7dae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:17.169807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b03bc-337d-4fc5-afe7-85910f7dae97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:17.170441 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b03bc-337d-4fc5-afe7-85910f7dae97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:17.172068 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b03bc-337d-4fc5-afe7-85910f7dae97 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:17.181717 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1409/2826] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:17.186401 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85575-9438-46cb-9a2b-4212b28251ac admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:17.196950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85575-9438-46cb-9a2b-4212b28251ac admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:17.201506 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8259-85a6-4a85-96e2-bda00c7a7f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:17.202146 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8259-85a6-4a85-96e2-bda00c7a7f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:17.202428 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8259-85a6-4a85-96e2-bda00c7a7f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:17.202725 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8259-85a6-4a85-96e2-bda00c7a7f96 admin admin] PATH_INFO: `/v3/projects/2ae938e9b258456989f0397f62ba24e0/users/d6c3ea1ff5bf437c8c695c409cf2f652/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:17.204616 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a8259-85a6-4a85-96e2-bda00c7a7f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae938e9b258456989f0397f62ba24e0, user_id=d6c3ea1ff5bf437c8c695c409cf2f652, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:17.207272 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a8259-85a6-4a85-96e2-bda00c7a7f96 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:17.217662 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1418/2827] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:17 2022] PUT /identity/v3/projects/2ae938e9b258456989f0397f62ba24e0/users/d6c3ea1ff5bf437c8c695c409cf2f652/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:17.227888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b8a7e-e5a7-4612-b7c2-013ba07946b1 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:17.228186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b8a7e-e5a7-4612-b7c2-013ba07946b1 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:17.228458 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b8a7e-e5a7-4612-b7c2-013ba07946b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:17.255549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8d6b8a7e-e5a7-4612-b7c2-013ba07946b1 None None] MFA Rules not processed for user `d6c3ea1ff5bf437c8c695c409cf2f652`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:17.256764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8d6b8a7e-e5a7-4612-b7c2-013ba07946b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:17.325328 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1410/2828] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:45:17.337102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8259-85a6-4a85-96e2-bda00c7a7f96 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:17.338827 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-246a8259-85a6-4a85-96e2-bda00c7a7f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:17.395409 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8259-85a6-4a85-96e2-bda00c7a7f96 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:17.399222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24779741-94a8-4df4-85cd-1c05e1e9c88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:17.399813 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24779741-94a8-4df4-85cd-1c05e1e9c88f service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:17.400090 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24779741-94a8-4df4-85cd-1c05e1e9c88f service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:17.400359 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24779741-94a8-4df4-85cd-1c05e1e9c88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:17.409079 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24779741-94a8-4df4-85cd-1c05e1e9c88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:17.410491 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24779741-94a8-4df4-85cd-1c05e1e9c88f service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:17.419733 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1419/2829] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:45:17.494848 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b8a7e-e5a7-4612-b7c2-013ba07946b1 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:17.504731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b8a7e-e5a7-4612-b7c2-013ba07946b1 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:17.509004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec385d7e-5259-46ba-8fbb-8bea4e8cb8e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:17.509596 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec385d7e-5259-46ba-8fbb-8bea4e8cb8e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:17.509873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec385d7e-5259-46ba-8fbb-8bea4e8cb8e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:17.510145 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec385d7e-5259-46ba-8fbb-8bea4e8cb8e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:17.564473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec385d7e-5259-46ba-8fbb-8bea4e8cb8e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:17.565883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec385d7e-5259-46ba-8fbb-8bea4e8cb8e2 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:17.575146 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1411/2830] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:27.415667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=56,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:27.571260 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=73 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:46.632488 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24779741-94a8-4df4-85cd-1c05e1e9c88f service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:46.692667 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24779741-94a8-4df4-85cd-1c05e1e9c88f service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:46.697231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:46.697855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:46.698134 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:46.698407 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] PATH_INFO: `/v3/users/e324ce76f1124a53a01c23558202b3a8` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:46.700369 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e324ce76f1124a53a01c23558202b3a8)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:46.702275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:46.744892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e324ce76f1124a53a01c23558202b3a8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:46.745529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e324ce76f1124a53a01c23558202b3a8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:46.752696 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e324ce76f1124a53a01c23558202b3a8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:46.753318 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e324ce76f1124a53a01c23558202b3a8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:46.765823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e324ce76f1124a53a01c23558202b3a8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:46.777713 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1420/2831] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:46 2022] DELETE /identity/v3/users/e324ce76f1124a53a01c23558202b3a8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:46.782199 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4057e3-54cc-44b3-a81a-c3671c7b3608 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:46.782737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4057e3-54cc-44b3-a81a-c3671c7b3608 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:46.782862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4057e3-54cc-44b3-a81a-c3671c7b3608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:46.801591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-8b4057e3-54cc-44b3-a81a-c3671c7b3608 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:46.802828 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8b4057e3-54cc-44b3-a81a-c3671c7b3608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:46.862443 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1412/2832] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:46.872757 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:46.874159 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:46.929909 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff370d7-c49c-403b-9199-c95186b925f8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:46.934234 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a6e4e-a91a-47f7-bef8-46e4f79f46e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:46.934863 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6e4e-a91a-47f7-bef8-46e4f79f46e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:46.935147 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6e4e-a91a-47f7-bef8-46e4f79f46e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:46.935420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6e4e-a91a-47f7-bef8-46e4f79f46e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:46.944350 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a6e4e-a91a-47f7-bef8-46e4f79f46e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:46.945868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a6e4e-a91a-47f7-bef8-46e4f79f46e7 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:46.955224 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1421/2833] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:45:47.219502 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4057e3-54cc-44b3-a81a-c3671c7b3608 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:47.220902 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-8b4057e3-54cc-44b3-a81a-c3671c7b3608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:47.235036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4057e3-54cc-44b3-a81a-c3671c7b3608 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:47.239850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:47.240491 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:47.240772 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:47.241042 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] PATH_INFO: `/v3/projects/8bfd35a7972d41d59e5b30be768a53bb` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:47.242160 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfd35a7972d41d59e5b30be768a53bb)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:47.244694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:47.290666 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfd35a7972d41d59e5b30be768a53bb', 'request_id': 'req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.297140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfd35a7972d41d59e5b30be768a53bb', 'request_id': 'req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.302983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfd35a7972d41d59e5b30be768a53bb', 'request_id': 'req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.316357 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] The token cache is being invalidate because project 8bfd35a7972d41d59e5b30be768a53bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:47.316675 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.317297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.318786 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1413/2834] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:47 2022] DELETE /identity/v3/projects/8bfd35a7972d41d59e5b30be768a53bb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:47.322766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a6e4e-a91a-47f7-bef8-46e4f79f46e7 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:47.332614 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a6e4e-a91a-47f7-bef8-46e4f79f46e7 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:47.351283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:47.390950 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:47.391590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:47.391865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:47.392132 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] PATH_INFO: `/v3/users/d6c3ea1ff5bf437c8c695c409cf2f652` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:47.393226 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c3ea1ff5bf437c8c695c409cf2f652)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:47.395197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:47.439823 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c3ea1ff5bf437c8c695c409cf2f652'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.440450 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c3ea1ff5bf437c8c695c409cf2f652'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.447183 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c3ea1ff5bf437c8c695c409cf2f652'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.447795 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c3ea1ff5bf437c8c695c409cf2f652'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.459641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f89f4529-59b2-4bb4-bb84-7b0be1609198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c3ea1ff5bf437c8c695c409cf2f652'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.473327 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1422/2835] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:47 2022] DELETE /identity/v3/users/d6c3ea1ff5bf437c8c695c409cf2f652 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:47.745623 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:47.747284 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:47.760130 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be79b6-9553-4a8a-92f5-99aa4d4bc519 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:47.815764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:47.816385 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:47.816704 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:47.816955 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] PATH_INFO: `/v3/projects/2ae938e9b258456989f0397f62ba24e0` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:47.818081 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae938e9b258456989f0397f62ba24e0)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:47.820104 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:47.849748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:47.867820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae938e9b258456989f0397f62ba24e0', 'request_id': 'req-69310b3d-9a21-41ef-bf9d-917bbad51f30'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.873783 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae938e9b258456989f0397f62ba24e0', 'request_id': 'req-69310b3d-9a21-41ef-bf9d-917bbad51f30'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.879281 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae938e9b258456989f0397f62ba24e0', 'request_id': 'req-69310b3d-9a21-41ef-bf9d-917bbad51f30'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.891983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] The token cache is being invalidate because project 2ae938e9b258456989f0397f62ba24e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:47.892274 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.892893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-69310b3d-9a21-41ef-bf9d-917bbad51f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:47.894370 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1414/2836] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:47 2022] DELETE /identity/v3/projects/2ae938e9b258456989f0397f62ba24e0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:47.899321 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016add2b-6282-4900-ab20-5246671db30d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:47.899778 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016add2b-6282-4900-ab20-5246671db30d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:47.899895 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016add2b-6282-4900-ab20-5246671db30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:47.921626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-016add2b-6282-4900-ab20-5246671db30d None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:47.922890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-016add2b-6282-4900-ab20-5246671db30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:47.981732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1423/2837] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:47.989456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6eff7-c5bb-4095-8dd2-4e2d6f557fde None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:47.989746 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6eff7-c5bb-4095-8dd2-4e2d6f557fde None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:47.990021 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6eff7-c5bb-4095-8dd2-4e2d6f557fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.009709 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-bff6eff7-c5bb-4095-8dd2-4e2d6f557fde None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:48.010957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-bff6eff7-c5bb-4095-8dd2-4e2d6f557fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:48.019736 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1415/2838] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:48.023806 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016add2b-6282-4900-ab20-5246671db30d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.033303 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016add2b-6282-4900-ab20-5246671db30d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.038007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28f25e-476a-4119-b751-dd90d7d1f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.038605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28f25e-476a-4119-b751-dd90d7d1f2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.038924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28f25e-476a-4119-b751-dd90d7d1f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.039199 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28f25e-476a-4119-b751-dd90d7d1f2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.039843 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28f25e-476a-4119-b751-dd90d7d1f2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:48.040149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28f25e-476a-4119-b751-dd90d7d1f2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.041884 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28f25e-476a-4119-b751-dd90d7d1f2c9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.053264 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1424/2839] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:48.057356 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6eff7-c5bb-4095-8dd2-4e2d6f557fde None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.067078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6eff7-c5bb-4095-8dd2-4e2d6f557fde None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.071806 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ae43f-93d5-41a6-8b6e-90ab70197c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.072326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ae43f-93d5-41a6-8b6e-90ab70197c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.072599 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ae43f-93d5-41a6-8b6e-90ab70197c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.072866 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ae43f-93d5-41a6-8b6e-90ab70197c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.073488 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ae43f-93d5-41a6-8b6e-90ab70197c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.076116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ae43f-93d5-41a6-8b6e-90ab70197c17 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.103019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1416/2840] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:48 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:45:48.107406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28f25e-476a-4119-b751-dd90d7d1f2c9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.117005 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28f25e-476a-4119-b751-dd90d7d1f2c9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.143398 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:48.175168 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a166e8f-36e1-469b-ac86-25f9fab20e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.175767 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166e8f-36e1-469b-ac86-25f9fab20e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.176046 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166e8f-36e1-469b-ac86-25f9fab20e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.176314 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166e8f-36e1-469b-ac86-25f9fab20e41 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.176930 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a166e8f-36e1-469b-ac86-25f9fab20e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.178852 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a166e8f-36e1-469b-ac86-25f9fab20e41 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.200148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1425/2841] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:48 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:48.204336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ae43f-93d5-41a6-8b6e-90ab70197c17 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.214842 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ae43f-93d5-41a6-8b6e-90ab70197c17 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.219449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e471e-8402-49d1-94c8-63cf6e0c89f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.220044 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e471e-8402-49d1-94c8-63cf6e0c89f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.220325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e471e-8402-49d1-94c8-63cf6e0c89f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.220598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e471e-8402-49d1-94c8-63cf6e0c89f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.221242 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e471e-8402-49d1-94c8-63cf6e0c89f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.222903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e471e-8402-49d1-94c8-63cf6e0c89f4 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.232694 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1417/2842] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:48.236590 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a166e8f-36e1-469b-ac86-25f9fab20e41 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.247116 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a166e8f-36e1-469b-ac86-25f9fab20e41 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.251691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7632d2d-ecba-41b6-b8d4-52a3103968d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.252280 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632d2d-ecba-41b6-b8d4-52a3103968d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.252560 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632d2d-ecba-41b6-b8d4-52a3103968d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.252924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632d2d-ecba-41b6-b8d4-52a3103968d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.253564 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7632d2d-ecba-41b6-b8d4-52a3103968d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.255178 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7632d2d-ecba-41b6-b8d4-52a3103968d1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.266427 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1426/2843] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:48.270470 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e471e-8402-49d1-94c8-63cf6e0c89f4 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.280978 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e471e-8402-49d1-94c8-63cf6e0c89f4 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.285686 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c5eb-b13f-409b-99b2-965847fdca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.286320 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c5eb-b13f-409b-99b2-965847fdca3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.286604 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c5eb-b13f-409b-99b2-965847fdca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.286920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c5eb-b13f-409b-99b2-965847fdca3b admin admin] PATH_INFO: `/v3/projects/209337434e564c2ba64e4d7478908282/users/0db32be377834ab5bfc52968e6c845ff/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.302628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85c5eb-b13f-409b-99b2-965847fdca3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=209337434e564c2ba64e4d7478908282, user_id=0db32be377834ab5bfc52968e6c845ff, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.305319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85c5eb-b13f-409b-99b2-965847fdca3b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.319539 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1418/2844] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:48 2022] PUT /identity/v3/projects/209337434e564c2ba64e4d7478908282/users/0db32be377834ab5bfc52968e6c845ff/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:48.331976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a5646-f532-49b6-a484-f39739128019 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.332207 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a5646-f532-49b6-a484-f39739128019 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.332481 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a5646-f532-49b6-a484-f39739128019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.359762 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-585a5646-f532-49b6-a484-f39739128019 None None] MFA Rules not processed for user `0db32be377834ab5bfc52968e6c845ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:48.360965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-585a5646-f532-49b6-a484-f39739128019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:48.424541 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1427/2845] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:48.429029 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c5eb-b13f-409b-99b2-965847fdca3b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.488633 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c5eb-b13f-409b-99b2-965847fdca3b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.493270 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569ac0f-96f0-4e6f-bdc0-b82705e73f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.493873 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569ac0f-96f0-4e6f-bdc0-b82705e73f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.494150 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569ac0f-96f0-4e6f-bdc0-b82705e73f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.494417 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569ac0f-96f0-4e6f-bdc0-b82705e73f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.495158 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569ac0f-96f0-4e6f-bdc0-b82705e73f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.497765 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569ac0f-96f0-4e6f-bdc0-b82705e73f76 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.523172 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1419/2846] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:48 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:48.527539 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a5646-f532-49b6-a484-f39739128019 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.538000 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a5646-f532-49b6-a484-f39739128019 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.592787 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593116f-10e1-4a79-9ac2-93cd45f04a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.593339 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593116f-10e1-4a79-9ac2-93cd45f04a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.593622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593116f-10e1-4a79-9ac2-93cd45f04a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.593892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593116f-10e1-4a79-9ac2-93cd45f04a75 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.594516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593116f-10e1-4a79-9ac2-93cd45f04a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.596467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593116f-10e1-4a79-9ac2-93cd45f04a75 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.617113 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1428/2847] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:48 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:48.621714 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569ac0f-96f0-4e6f-bdc0-b82705e73f76 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.631805 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569ac0f-96f0-4e6f-bdc0-b82705e73f76 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.636549 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52243c-0e00-4378-a0d8-b7cec8912da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.637017 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52243c-0e00-4378-a0d8-b7cec8912da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.637293 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52243c-0e00-4378-a0d8-b7cec8912da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.637565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52243c-0e00-4378-a0d8-b7cec8912da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.638201 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52243c-0e00-4378-a0d8-b7cec8912da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.640067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52243c-0e00-4378-a0d8-b7cec8912da8 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.650251 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1420/2848] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:45:48.654423 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593116f-10e1-4a79-9ac2-93cd45f04a75 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.664300 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593116f-10e1-4a79-9ac2-93cd45f04a75 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.669549 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfafc6-1cb5-49c7-b200-300e1cebf520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.670191 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfafc6-1cb5-49c7-b200-300e1cebf520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.670467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfafc6-1cb5-49c7-b200-300e1cebf520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.670768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfafc6-1cb5-49c7-b200-300e1cebf520 admin admin] PATH_INFO: `/v3/projects/8d141e6db9a64fdea39208589143cb1d/users/05f6a637678f4db081d1841d8e086671/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.685719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfafc6-1cb5-49c7-b200-300e1cebf520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d141e6db9a64fdea39208589143cb1d, user_id=05f6a637678f4db081d1841d8e086671, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.688366 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfafc6-1cb5-49c7-b200-300e1cebf520 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.700529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1429/2849] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:48 2022] PUT /identity/v3/projects/8d141e6db9a64fdea39208589143cb1d/users/05f6a637678f4db081d1841d8e086671/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:48.704448 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52243c-0e00-4378-a0d8-b7cec8912da8 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.715165 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52243c-0e00-4378-a0d8-b7cec8912da8 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.736080 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:48.774238 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d6946-7ec6-426a-851a-7ded68d3fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.774868 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d6946-7ec6-426a-851a-7ded68d3fec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.775153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d6946-7ec6-426a-851a-7ded68d3fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.775426 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d6946-7ec6-426a-851a-7ded68d3fec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.776064 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d6946-7ec6-426a-851a-7ded68d3fec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.778584 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d6946-7ec6-426a-851a-7ded68d3fec5 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.788066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1421/2850] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:48.792182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfafc6-1cb5-49c7-b200-300e1cebf520 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.798177 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:48.804182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfafc6-1cb5-49c7-b200-300e1cebf520 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:48.809313 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209d4c8-02c7-4c0b-a82f-1b4c9e2f6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:48.809957 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209d4c8-02c7-4c0b-a82f-1b4c9e2f6051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.810233 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209d4c8-02c7-4c0b-a82f-1b4c9e2f6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.810510 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209d4c8-02c7-4c0b-a82f-1b4c9e2f6051 admin admin] PATH_INFO: `/v3/projects/8d141e6db9a64fdea39208589143cb1d/users/05f6a637678f4db081d1841d8e086671/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.812406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209d4c8-02c7-4c0b-a82f-1b4c9e2f6051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d141e6db9a64fdea39208589143cb1d, user_id=05f6a637678f4db081d1841d8e086671, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:48.815074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209d4c8-02c7-4c0b-a82f-1b4c9e2f6051 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:48.825195 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1430/2851] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:48 2022] PUT /identity/v3/projects/8d141e6db9a64fdea39208589143cb1d/users/05f6a637678f4db081d1841d8e086671/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:48.887609 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706145c9-f63c-4e90-8472-7d61ba6806ff None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.888136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706145c9-f63c-4e90-8472-7d61ba6806ff None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.888136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706145c9-f63c-4e90-8472-7d61ba6806ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.915386 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-706145c9-f63c-4e90-8472-7d61ba6806ff None None] MFA Rules not processed for user `05f6a637678f4db081d1841d8e086671`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:48.916591 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-706145c9-f63c-4e90-8472-7d61ba6806ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:48.982326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1422/2852] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:48.993314 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209d4c8-02c7-4c0b-a82f-1b4c9e2f6051 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:48.995096 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f209d4c8-02c7-4c0b-a82f-1b4c9e2f6051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:49.050685 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209d4c8-02c7-4c0b-a82f-1b4c9e2f6051 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:49.054211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d250da-16b6-45d7-8ea6-2321f495aaa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:49.054829 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d250da-16b6-45d7-8ea6-2321f495aaa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:49.055106 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d250da-16b6-45d7-8ea6-2321f495aaa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:49.055370 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d250da-16b6-45d7-8ea6-2321f495aaa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:49.064033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d250da-16b6-45d7-8ea6-2321f495aaa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:49.065443 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d250da-16b6-45d7-8ea6-2321f495aaa4 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:49.074584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1431/2853] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:49.468882 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706145c9-f63c-4e90-8472-7d61ba6806ff None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:49.531964 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706145c9-f63c-4e90-8472-7d61ba6806ff None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:49.536497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:49.537117 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:49.537396 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:49.537667 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] PATH_INFO: `/v3/users/0db32be377834ab5bfc52968e6c845ff` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:49.538847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db32be377834ab5bfc52968e6c845ff)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:49.540751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:49.584608 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db32be377834ab5bfc52968e6c845ff'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:49.585253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db32be377834ab5bfc52968e6c845ff'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:49.586373 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:49.598520 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db32be377834ab5bfc52968e6c845ff'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:49.605241 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db32be377834ab5bfc52968e6c845ff'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:49.605893 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db32be377834ab5bfc52968e6c845ff'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:49.618662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1423/2854] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:49 2022] DELETE /identity/v3/users/0db32be377834ab5bfc52968e6c845ff => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:49.623972 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c3b1-f4ed-4645-9fcb-b3c935b7a1c0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:49.624262 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c3b1-f4ed-4645-9fcb-b3c935b7a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:49.624540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c3b1-f4ed-4645-9fcb-b3c935b7a1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:49.644362 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fcd8c3b1-f4ed-4645-9fcb-b3c935b7a1c0 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:49.645495 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fcd8c3b1-f4ed-4645-9fcb-b3c935b7a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:49.703247 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1432/2855] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:49.712779 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:49.714202 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:49.771449 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc458788-0ff4-47f3-8dd0-18dc50829c1b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:49.776048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e645624-e6c7-433f-9072-c759d2651f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:49.776728 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e645624-e6c7-433f-9072-c759d2651f4e service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:49.777046 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e645624-e6c7-433f-9072-c759d2651f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:49.777329 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e645624-e6c7-433f-9072-c759d2651f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:49.786877 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e645624-e6c7-433f-9072-c759d2651f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:49.788312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e645624-e6c7-433f-9072-c759d2651f4e service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:49.797931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1424/2856] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:50.061437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c3b1-f4ed-4645-9fcb-b3c935b7a1c0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:50.062892 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fcd8c3b1-f4ed-4645-9fcb-b3c935b7a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:50.076024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c3b1-f4ed-4645-9fcb-b3c935b7a1c0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:50.080609 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:50.081260 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:50.081535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:50.081805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] PATH_INFO: `/v3/projects/209337434e564c2ba64e4d7478908282` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:50.083639 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209337434e564c2ba64e4d7478908282)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:50.085529 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:50.131422 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209337434e564c2ba64e4d7478908282', 'request_id': 'req-ada2a76a-0015-4b1b-bd2f-c07f7165f082'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.136869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209337434e564c2ba64e4d7478908282', 'request_id': 'req-ada2a76a-0015-4b1b-bd2f-c07f7165f082'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.143013 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209337434e564c2ba64e4d7478908282', 'request_id': 'req-ada2a76a-0015-4b1b-bd2f-c07f7165f082'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.155638 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] The token cache is being invalidate because project 209337434e564c2ba64e4d7478908282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:50.155934 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.156558 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.158104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1433/2857] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:50 2022] DELETE /identity/v3/projects/209337434e564c2ba64e4d7478908282 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:50.162140 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e645624-e6c7-433f-9072-c759d2651f4e service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:50.172847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e645624-e6c7-433f-9072-c759d2651f4e service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:50.228486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:50.229036 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:50.229315 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:50.229587 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] PATH_INFO: `/v3/users/05f6a637678f4db081d1841d8e086671` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:50.231380 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f6a637678f4db081d1841d8e086671)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:50.233312 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:50.276473 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f6a637678f4db081d1841d8e086671'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.277657 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f6a637678f4db081d1841d8e086671'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.289445 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f6a637678f4db081d1841d8e086671'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.294377 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:50.298774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f6a637678f4db081d1841d8e086671'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.299720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-8ded4489-b044-457d-86e8-c6b8b7e06109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f6a637678f4db081d1841d8e086671'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.314409 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1425/2858] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:50 2022] DELETE /identity/v3/users/05f6a637678f4db081d1841d8e086671 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:50.586473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:50.588169 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:50.602494 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2a76a-0015-4b1b-bd2f-c07f7165f082 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:50.621993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:50.669796 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:50.670420 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:50.670724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:50.671003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] PATH_INFO: `/v3/projects/8d141e6db9a64fdea39208589143cb1d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:50.672111 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d141e6db9a64fdea39208589143cb1d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:50.674004 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:50.718977 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d141e6db9a64fdea39208589143cb1d', 'request_id': 'req-88d26d83-c53d-4b58-abf5-8dd8437a7d15'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.724355 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d141e6db9a64fdea39208589143cb1d', 'request_id': 'req-88d26d83-c53d-4b58-abf5-8dd8437a7d15'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.730626 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d141e6db9a64fdea39208589143cb1d', 'request_id': 'req-88d26d83-c53d-4b58-abf5-8dd8437a7d15'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.743751 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] The token cache is being invalidate because project 8d141e6db9a64fdea39208589143cb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:50.744037 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.744648 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-88d26d83-c53d-4b58-abf5-8dd8437a7d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:50.746164 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1434/2859] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:50 2022] DELETE /identity/v3/projects/8d141e6db9a64fdea39208589143cb1d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:50.751013 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433a9f-ece2-4d3f-94c5-949808f338fc None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:50.751304 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433a9f-ece2-4d3f-94c5-949808f338fc None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:50.751588 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433a9f-ece2-4d3f-94c5-949808f338fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:50.771456 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-6e433a9f-ece2-4d3f-94c5-949808f338fc None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:50.772597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-6e433a9f-ece2-4d3f-94c5-949808f338fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:50.848997 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1426/2860] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:50.857938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cd38d-f1b8-4386-bf9f-9cb425cb07d6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:50.858222 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cd38d-f1b8-4386-bf9f-9cb425cb07d6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:50.858521 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cd38d-f1b8-4386-bf9f-9cb425cb07d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:50.879413 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-687cd38d-f1b8-4386-bf9f-9cb425cb07d6 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:50.880622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-687cd38d-f1b8-4386-bf9f-9cb425cb07d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:50.888890 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1435/2861] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:50.893266 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e433a9f-ece2-4d3f-94c5-949808f338fc None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:50.903228 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e433a9f-ece2-4d3f-94c5-949808f338fc None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:50.907813 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1401d-ba3a-4bda-913f-f8b1a375575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:50.908405 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1401d-ba3a-4bda-913f-f8b1a375575f admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:50.908683 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1401d-ba3a-4bda-913f-f8b1a375575f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:50.908953 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1401d-ba3a-4bda-913f-f8b1a375575f admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:50.909600 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1401d-ba3a-4bda-913f-f8b1a375575f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:50.909903 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1401d-ba3a-4bda-913f-f8b1a375575f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:50.911535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1401d-ba3a-4bda-913f-f8b1a375575f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:50.923525 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1427/2862] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:50.927865 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cd38d-f1b8-4386-bf9f-9cb425cb07d6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:50.937672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cd38d-f1b8-4386-bf9f-9cb425cb07d6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:50.942332 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a54dc-6063-4051-9b62-8610970214cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:50.942967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a54dc-6063-4051-9b62-8610970214cf admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:50.943246 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a54dc-6063-4051-9b62-8610970214cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:50.943513 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a54dc-6063-4051-9b62-8610970214cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:50.944122 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a54dc-6063-4051-9b62-8610970214cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:50.945998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a54dc-6063-4051-9b62-8610970214cf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:50.972688 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1436/2863] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:50 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:50.976841 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1401d-ba3a-4bda-913f-f8b1a375575f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:50.987371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1401d-ba3a-4bda-913f-f8b1a375575f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.041678 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487ccbe-7590-4379-add9-e11106413ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.042207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487ccbe-7590-4379-add9-e11106413ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.042486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487ccbe-7590-4379-add9-e11106413ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.043391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487ccbe-7590-4379-add9-e11106413ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.044186 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487ccbe-7590-4379-add9-e11106413ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.046085 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487ccbe-7590-4379-add9-e11106413ae3 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.067092 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1428/2864] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:50 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:51.071179 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a54dc-6063-4051-9b62-8610970214cf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:51.081669 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a54dc-6063-4051-9b62-8610970214cf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.086160 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1db1e-3d20-43d8-9082-acf32a4b418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.086850 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1db1e-3d20-43d8-9082-acf32a4b418f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.087130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1db1e-3d20-43d8-9082-acf32a4b418f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.087403 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1db1e-3d20-43d8-9082-acf32a4b418f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.088039 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1db1e-3d20-43d8-9082-acf32a4b418f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.090283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1db1e-3d20-43d8-9082-acf32a4b418f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.100071 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1437/2865] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:51.104089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487ccbe-7590-4379-add9-e11106413ae3 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:51.114862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487ccbe-7590-4379-add9-e11106413ae3 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.119486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa82b0-a32e-4662-95e4-2eecced163aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.120078 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa82b0-a32e-4662-95e4-2eecced163aa admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.120358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa82b0-a32e-4662-95e4-2eecced163aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.120637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa82b0-a32e-4662-95e4-2eecced163aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.121297 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa82b0-a32e-4662-95e4-2eecced163aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.123011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa82b0-a32e-4662-95e4-2eecced163aa admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.133392 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1429/2866] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:51.137561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1db1e-3d20-43d8-9082-acf32a4b418f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:51.147738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1db1e-3d20-43d8-9082-acf32a4b418f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.152959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ec243-a67e-4346-8395-f58248cb18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.153587 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec243-a67e-4346-8395-f58248cb18b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.153867 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec243-a67e-4346-8395-f58248cb18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.154140 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec243-a67e-4346-8395-f58248cb18b9 admin admin] PATH_INFO: `/v3/projects/2a5d4f0b4eee4677a5e1ffe5b3a8e25a/users/4a3d362f6ea44b77a309e689d918ad61/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.169603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ec243-a67e-4346-8395-f58248cb18b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5d4f0b4eee4677a5e1ffe5b3a8e25a, user_id=4a3d362f6ea44b77a309e689d918ad61, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.172258 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ec243-a67e-4346-8395-f58248cb18b9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.185143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1438/2867] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:51 2022] PUT /identity/v3/projects/2a5d4f0b4eee4677a5e1ffe5b3a8e25a/users/4a3d362f6ea44b77a309e689d918ad61/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:51.196444 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e83c9-6678-49f2-b4f0-d59940d2a8e6 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.196918 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e83c9-6678-49f2-b4f0-d59940d2a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.197045 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e83c9-6678-49f2-b4f0-d59940d2a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.226767 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-ba4e83c9-6678-49f2-b4f0-d59940d2a8e6 None None] MFA Rules not processed for user `4a3d362f6ea44b77a309e689d918ad61`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:51.227981 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-ba4e83c9-6678-49f2-b4f0-d59940d2a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:51.268340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:51.292224 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1430/2868] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:51.297252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ec243-a67e-4346-8395-f58248cb18b9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:51.343817 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:51.363530 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ec243-a67e-4346-8395-f58248cb18b9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.368115 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a7988-30c8-4d3b-bdf9-dcd3f4a037bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.368710 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a7988-30c8-4d3b-bdf9-dcd3f4a037bd admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.369012 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a7988-30c8-4d3b-bdf9-dcd3f4a037bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.369281 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a7988-30c8-4d3b-bdf9-dcd3f4a037bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.369898 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a7988-30c8-4d3b-bdf9-dcd3f4a037bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.371912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a7988-30c8-4d3b-bdf9-dcd3f4a037bd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.397637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1439/2869] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:51 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:51.401916 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e83c9-6678-49f2-b4f0-d59940d2a8e6 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:51.413378 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e83c9-6678-49f2-b4f0-d59940d2a8e6 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.468136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abd157-46a8-42a2-9abb-898bf8470e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.468862 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abd157-46a8-42a2-9abb-898bf8470e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.469212 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abd157-46a8-42a2-9abb-898bf8470e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.469558 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abd157-46a8-42a2-9abb-898bf8470e1c admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.470342 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abd157-46a8-42a2-9abb-898bf8470e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.472348 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abd157-46a8-42a2-9abb-898bf8470e1c admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.493171 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1431/2870] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:51 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:51.497309 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a7988-30c8-4d3b-bdf9-dcd3f4a037bd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:51.515575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a7988-30c8-4d3b-bdf9-dcd3f4a037bd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.520157 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32cafa-ba81-46bb-818b-633ae3d2b1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.520749 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32cafa-ba81-46bb-818b-633ae3d2b1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.521025 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32cafa-ba81-46bb-818b-633ae3d2b1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.521293 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32cafa-ba81-46bb-818b-633ae3d2b1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.521924 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32cafa-ba81-46bb-818b-633ae3d2b1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.523565 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32cafa-ba81-46bb-818b-633ae3d2b1d9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.534445 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1440/2871] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:51.538577 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abd157-46a8-42a2-9abb-898bf8470e1c admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:51.548643 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abd157-46a8-42a2-9abb-898bf8470e1c admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.553213 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258d035-0db1-4b9a-94b5-df682f2929bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.553849 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258d035-0db1-4b9a-94b5-df682f2929bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.554124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258d035-0db1-4b9a-94b5-df682f2929bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.554394 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258d035-0db1-4b9a-94b5-df682f2929bc admin admin] PATH_INFO: `/v3/projects/b563f178258445dba400a81167901fd8/users/276de9fce56d47ef8ff4a4c23ffc31a7/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.568504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258d035-0db1-4b9a-94b5-df682f2929bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b563f178258445dba400a81167901fd8, user_id=276de9fce56d47ef8ff4a4c23ffc31a7, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.571153 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258d035-0db1-4b9a-94b5-df682f2929bc admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.583890 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1432/2872] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:51 2022] PUT /identity/v3/projects/b563f178258445dba400a81167901fd8/users/276de9fce56d47ef8ff4a4c23ffc31a7/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:45:51.587745 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32cafa-ba81-46bb-818b-633ae3d2b1d9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:51.597976 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32cafa-ba81-46bb-818b-633ae3d2b1d9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.652938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3069cc5-3c26-4e44-9066-18a7d7af72d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.653527 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069cc5-3c26-4e44-9066-18a7d7af72d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.653804 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069cc5-3c26-4e44-9066-18a7d7af72d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.654074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069cc5-3c26-4e44-9066-18a7d7af72d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.654724 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3069cc5-3c26-4e44-9066-18a7d7af72d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.656302 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3069cc5-3c26-4e44-9066-18a7d7af72d2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.665701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1441/2873] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:51.669846 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258d035-0db1-4b9a-94b5-df682f2929bc admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:51.679832 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258d035-0db1-4b9a-94b5-df682f2929bc admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.684462 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48499e-439a-420c-94ac-ee77ed486b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.685091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48499e-439a-420c-94ac-ee77ed486b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.685368 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48499e-439a-420c-94ac-ee77ed486b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.685637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48499e-439a-420c-94ac-ee77ed486b43 admin admin] PATH_INFO: `/v3/projects/b563f178258445dba400a81167901fd8/users/276de9fce56d47ef8ff4a4c23ffc31a7/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.687562 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48499e-439a-420c-94ac-ee77ed486b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b563f178258445dba400a81167901fd8, user_id=276de9fce56d47ef8ff4a4c23ffc31a7, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.690143 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48499e-439a-420c-94ac-ee77ed486b43 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.700450 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1433/2874] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:51 2022] PUT /identity/v3/projects/b563f178258445dba400a81167901fd8/users/276de9fce56d47ef8ff4a4c23ffc31a7/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:51.710645 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d925-a4af-4837-a735-c2c2a6b3b296 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.710962 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d925-a4af-4837-a735-c2c2a6b3b296 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.711238 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d925-a4af-4837-a735-c2c2a6b3b296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.738802 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3ba0d925-a4af-4837-a735-c2c2a6b3b296 None None] MFA Rules not processed for user `276de9fce56d47ef8ff4a4c23ffc31a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:51.739992 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3ba0d925-a4af-4837-a735-c2c2a6b3b296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:51.809198 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1442/2875] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:51.820077 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48499e-439a-420c-94ac-ee77ed486b43 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:51.821774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-7c48499e-439a-420c-94ac-ee77ed486b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:51.879051 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48499e-439a-420c-94ac-ee77ed486b43 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:51.882662 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6efae3-c8b4-4605-bc39-cab7bfd43e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:51.883288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6efae3-c8b4-4605-bc39-cab7bfd43e48 service cinder] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.883569 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6efae3-c8b4-4605-bc39-cab7bfd43e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.883840 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6efae3-c8b4-4605-bc39-cab7bfd43e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.893758 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6efae3-c8b4-4605-bc39-cab7bfd43e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:51.895225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6efae3-c8b4-4605-bc39-cab7bfd43e48 service cinder] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:51.904725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1434/2876] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:51.970776 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0d925-a4af-4837-a735-c2c2a6b3b296 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:52.011149 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:52.033709 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0d925-a4af-4837-a735-c2c2a6b3b296 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:52.038185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:52.038853 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:52.039131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:52.039417 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] PATH_INFO: `/v3/users/4a3d362f6ea44b77a309e689d918ad61` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:52.040523 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a3d362f6ea44b77a309e689d918ad61)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:52.042478 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:52.088942 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a3d362f6ea44b77a309e689d918ad61'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.089596 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a3d362f6ea44b77a309e689d918ad61'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.096777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a3d362f6ea44b77a309e689d918ad61'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.097387 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a3d362f6ea44b77a309e689d918ad61'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.109375 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a3d362f6ea44b77a309e689d918ad61'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.122646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1443/2877] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:51 2022] DELETE /identity/v3/users/4a3d362f6ea44b77a309e689d918ad61 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:52.127182 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f68c0c-6e7b-49bf-81a9-b81389500860 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:52.127545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f68c0c-6e7b-49bf-81a9-b81389500860 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:52.127883 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f68c0c-6e7b-49bf-81a9-b81389500860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:52.146302 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-e6f68c0c-6e7b-49bf-81a9-b81389500860 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:52.147535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e6f68c0c-6e7b-49bf-81a9-b81389500860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:52.178136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:52.206303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1435/2878] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:45:52.216085 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:52.217483 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:52.273653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799ed66-c8c6-41de-bf10-163f630aa817 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:52.277367 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec128d4-00b2-4372-a760-23e56a44bef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:52.278022 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec128d4-00b2-4372-a760-23e56a44bef9 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:52.278304 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec128d4-00b2-4372-a760-23e56a44bef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:52.278580 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec128d4-00b2-4372-a760-23e56a44bef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:52.287435 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec128d4-00b2-4372-a760-23e56a44bef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:52.288847 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec128d4-00b2-4372-a760-23e56a44bef9 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:52.298869 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1444/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:52.560820 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f68c0c-6e7b-49bf-81a9-b81389500860 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:52.562299 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-e6f68c0c-6e7b-49bf-81a9-b81389500860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:52.574734 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f68c0c-6e7b-49bf-81a9-b81389500860 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:52.579628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:52.580397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:52.580741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:52.581079 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] PATH_INFO: `/v3/projects/2a5d4f0b4eee4677a5e1ffe5b3a8e25a` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:52.582278 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5d4f0b4eee4677a5e1ffe5b3a8e25a)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:52.584210 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:52.631332 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5d4f0b4eee4677a5e1ffe5b3a8e25a', 'request_id': 'req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.637454 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5d4f0b4eee4677a5e1ffe5b3a8e25a', 'request_id': 'req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.643601 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5d4f0b4eee4677a5e1ffe5b3a8e25a', 'request_id': 'req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.656416 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] The token cache is being invalidate because project 2a5d4f0b4eee4677a5e1ffe5b3a8e25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:52.656700 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.657303 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.658761 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1436/2880] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:52 2022] DELETE /identity/v3/projects/2a5d4f0b4eee4677a5e1ffe5b3a8e25a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:45:52.662760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec128d4-00b2-4372-a760-23e56a44bef9 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:52.673242 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec128d4-00b2-4372-a760-23e56a44bef9 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:52.727929 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:52.728552 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:52.728861 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:52.729139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] PATH_INFO: `/v3/users/276de9fce56d47ef8ff4a4c23ffc31a7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:52.730855 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276de9fce56d47ef8ff4a4c23ffc31a7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:52.732766 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:52.734252 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:52.778651 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276de9fce56d47ef8ff4a4c23ffc31a7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.779319 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276de9fce56d47ef8ff4a4c23ffc31a7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.786053 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276de9fce56d47ef8ff4a4c23ffc31a7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.786697 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276de9fce56d47ef8ff4a4c23ffc31a7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.798870 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3c5f0a5-230b-4cb8-b056-27c5ec9c22f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276de9fce56d47ef8ff4a4c23ffc31a7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:52.811209 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1445/2881] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:52 2022] DELETE /identity/v3/users/276de9fce56d47ef8ff4a4c23ffc31a7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:53.090116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:53.091811 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:53.106159 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549cff5-8ba0-4659-8e9b-6eadb82adc4f admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:53.164319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:53.164860 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.165136 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.165402 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] PATH_INFO: `/v3/projects/b563f178258445dba400a81167901fd8` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.166504 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b563f178258445dba400a81167901fd8)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:53.168617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:53.223519 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b563f178258445dba400a81167901fd8', 'request_id': 'req-b33d7289-9eb4-4137-bafb-2bb7b52a232a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:53.229741 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b563f178258445dba400a81167901fd8', 'request_id': 'req-b33d7289-9eb4-4137-bafb-2bb7b52a232a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:53.235276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b563f178258445dba400a81167901fd8', 'request_id': 'req-b33d7289-9eb4-4137-bafb-2bb7b52a232a'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:53.237063 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:53.250725 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] The token cache is being invalidate because project b563f178258445dba400a81167901fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:53.251011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:53.251624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-b33d7289-9eb4-4137-bafb-2bb7b52a232a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:53.253124 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1437/2882] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:53 2022] DELETE /identity/v3/projects/b563f178258445dba400a81167901fd8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:53.258070 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e2ac6-cc46-4576-9fde-928003fcb60f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.258542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e2ac6-cc46-4576-9fde-928003fcb60f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.258693 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e2ac6-cc46-4576-9fde-928003fcb60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.278732 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d10e2ac6-cc46-4576-9fde-928003fcb60f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:53.281497 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d10e2ac6-cc46-4576-9fde-928003fcb60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:53.356368 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1446/2883] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:53.364843 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966af68d-6438-4700-a436-4dcefd9859e5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.365125 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966af68d-6438-4700-a436-4dcefd9859e5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.365397 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966af68d-6438-4700-a436-4dcefd9859e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.388067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-966af68d-6438-4700-a436-4dcefd9859e5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:53.390089 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-966af68d-6438-4700-a436-4dcefd9859e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:53.398223 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1438/2884] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:53.403925 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e2ac6-cc46-4576-9fde-928003fcb60f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:53.414782 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e2ac6-cc46-4576-9fde-928003fcb60f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:53.420047 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837e4d8-0134-4708-84eb-83ae7fb673aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:53.420655 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837e4d8-0134-4708-84eb-83ae7fb673aa admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.420938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837e4d8-0134-4708-84eb-83ae7fb673aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.421212 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837e4d8-0134-4708-84eb-83ae7fb673aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.421959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837e4d8-0134-4708-84eb-83ae7fb673aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:53.422464 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837e4d8-0134-4708-84eb-83ae7fb673aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:53.424672 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837e4d8-0134-4708-84eb-83ae7fb673aa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:53.438576 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1447/2885] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:53.443533 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966af68d-6438-4700-a436-4dcefd9859e5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:53.454408 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966af68d-6438-4700-a436-4dcefd9859e5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:53.460267 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdf971-54d9-465b-9914-26bb3af026ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:53.460962 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf971-54d9-465b-9914-26bb3af026ee admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.461467 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf971-54d9-465b-9914-26bb3af026ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.461914 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf971-54d9-465b-9914-26bb3af026ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.463001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdf971-54d9-465b-9914-26bb3af026ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:53.466557 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdf971-54d9-465b-9914-26bb3af026ee admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:53.496718 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1439/2886] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:53 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:53.501731 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837e4d8-0134-4708-84eb-83ae7fb673aa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:53.515344 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837e4d8-0134-4708-84eb-83ae7fb673aa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:53.581117 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adccd3-98fd-4a42-9ae7-984748afcc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:53.581727 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adccd3-98fd-4a42-9ae7-984748afcc22 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.582131 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adccd3-98fd-4a42-9ae7-984748afcc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.582637 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adccd3-98fd-4a42-9ae7-984748afcc22 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.583698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adccd3-98fd-4a42-9ae7-984748afcc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:53.587123 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adccd3-98fd-4a42-9ae7-984748afcc22 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:53.600904 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:53.614514 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1448/2887] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:53 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:53.619239 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdf971-54d9-465b-9914-26bb3af026ee admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:53.631295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdf971-54d9-465b-9914-26bb3af026ee admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:53.636847 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb7ad8-3f45-4a42-a68c-e79952ab4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:53.637469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb7ad8-3f45-4a42-a68c-e79952ab4a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.637966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb7ad8-3f45-4a42-a68c-e79952ab4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.638768 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb7ad8-3f45-4a42-a68c-e79952ab4a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.639598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb7ad8-3f45-4a42-a68c-e79952ab4a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:53.641310 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb7ad8-3f45-4a42-a68c-e79952ab4a08 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:53.653731 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1440/2888] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:53.658130 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adccd3-98fd-4a42-9ae7-984748afcc22 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:53.670253 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adccd3-98fd-4a42-9ae7-984748afcc22 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:53.675967 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ed4c-76e2-4ac5-ba80-958cda01d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:53.676584 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ed4c-76e2-4ac5-ba80-958cda01d0ae admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.677473 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ed4c-76e2-4ac5-ba80-958cda01d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.677760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ed4c-76e2-4ac5-ba80-958cda01d0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.678406 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9ed4c-76e2-4ac5-ba80-958cda01d0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:53.680102 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9ed4c-76e2-4ac5-ba80-958cda01d0ae admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:53.691837 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1449/2889] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:53.696322 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb7ad8-3f45-4a42-a68c-e79952ab4a08 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:53.706424 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb7ad8-3f45-4a42-a68c-e79952ab4a08 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:53.712781 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab177-a9bf-4c72-9f2a-253b0472eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:53.713506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab177-a9bf-4c72-9f2a-253b0472eb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.713976 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab177-a9bf-4c72-9f2a-253b0472eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.714503 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab177-a9bf-4c72-9f2a-253b0472eb6b admin admin] PATH_INFO: `/v3/projects/1a7994c2fa3145a0ae0c2ed3ec35e12d/users/d1f1bec9409f43afbe6d6b46011b57a2/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.729629 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ab177-a9bf-4c72-9f2a-253b0472eb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7994c2fa3145a0ae0c2ed3ec35e12d, user_id=d1f1bec9409f43afbe6d6b46011b57a2, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:53.732977 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ab177-a9bf-4c72-9f2a-253b0472eb6b admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:53.748398 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1441/2890] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:53 2022] PUT /identity/v3/projects/1a7994c2fa3145a0ae0c2ed3ec35e12d/users/d1f1bec9409f43afbe6d6b46011b57a2/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:53.765243 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023556ec-0bde-4695-b8c7-fb0a8cd8fbf8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.765760 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023556ec-0bde-4695-b8c7-fb0a8cd8fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.766108 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023556ec-0bde-4695-b8c7-fb0a8cd8fbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.799540 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-023556ec-0bde-4695-b8c7-fb0a8cd8fbf8 None None] MFA Rules not processed for user `d1f1bec9409f43afbe6d6b46011b57a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:53.800765 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-023556ec-0bde-4695-b8c7-fb0a8cd8fbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:53.872297 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1450/2891] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:53.876684 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab177-a9bf-4c72-9f2a-253b0472eb6b admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:53.948262 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab177-a9bf-4c72-9f2a-253b0472eb6b admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:53.953276 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f3c18-e749-452b-ae2f-a870be7a7f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:53.953879 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f3c18-e749-452b-ae2f-a870be7a7f2a admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:53.954154 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f3c18-e749-452b-ae2f-a870be7a7f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:53.954425 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f3c18-e749-452b-ae2f-a870be7a7f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:53.955086 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f3c18-e749-452b-ae2f-a870be7a7f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:53.957001 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f3c18-e749-452b-ae2f-a870be7a7f2a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:53.986851 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1442/2892] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:53 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:53.991336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023556ec-0bde-4695-b8c7-fb0a8cd8fbf8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:54.002460 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023556ec-0bde-4695-b8c7-fb0a8cd8fbf8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:54.066828 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce015e-afac-4c0b-93a4-a9c64e3de500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:54.067439 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce015e-afac-4c0b-93a4-a9c64e3de500 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:54.067719 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce015e-afac-4c0b-93a4-a9c64e3de500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:54.068081 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce015e-afac-4c0b-93a4-a9c64e3de500 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:54.068728 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce015e-afac-4c0b-93a4-a9c64e3de500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:54.070634 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce015e-afac-4c0b-93a4-a9c64e3de500 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:54.093011 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1451/2893] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:53 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:54.096834 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f3c18-e749-452b-ae2f-a870be7a7f2a admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:54.108111 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f3c18-e749-452b-ae2f-a870be7a7f2a admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:54.112625 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba526f6d-f0b1-448a-b6a4-f41517699996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:54.113271 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba526f6d-f0b1-448a-b6a4-f41517699996 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:54.113548 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba526f6d-f0b1-448a-b6a4-f41517699996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:54.113816 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba526f6d-f0b1-448a-b6a4-f41517699996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:54.114510 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba526f6d-f0b1-448a-b6a4-f41517699996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:54.116346 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba526f6d-f0b1-448a-b6a4-f41517699996 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:54.127316 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1443/2894] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:54.131603 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce015e-afac-4c0b-93a4-a9c64e3de500 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:54.142057 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce015e-afac-4c0b-93a4-a9c64e3de500 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:54.146702 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603c72f-44aa-4694-8331-1d522d0ebe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:54.147357 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c72f-44aa-4694-8331-1d522d0ebe5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:54.147640 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c72f-44aa-4694-8331-1d522d0ebe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:54.147913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c72f-44aa-4694-8331-1d522d0ebe5d admin admin] PATH_INFO: `/v3/projects/1d77e8ffbd1e44feb6cc72e7a7313d2d/users/486627ba211b4366a89d90b8273d87c4/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:54.163138 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603c72f-44aa-4694-8331-1d522d0ebe5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d77e8ffbd1e44feb6cc72e7a7313d2d, user_id=486627ba211b4366a89d90b8273d87c4, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:54.165783 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603c72f-44aa-4694-8331-1d522d0ebe5d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:54.179673 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1452/2895] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:54 2022] PUT /identity/v3/projects/1d77e8ffbd1e44feb6cc72e7a7313d2d/users/486627ba211b4366a89d90b8273d87c4/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:54.183720 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba526f6d-f0b1-448a-b6a4-f41517699996 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:54.194292 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba526f6d-f0b1-448a-b6a4-f41517699996 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:54.250362 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1939c1d-de95-4fdb-8f8f-2df237f335b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:54.251024 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1939c1d-de95-4fdb-8f8f-2df237f335b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:54.251185 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1939c1d-de95-4fdb-8f8f-2df237f335b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:54.251460 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1939c1d-de95-4fdb-8f8f-2df237f335b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:54.252099 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1939c1d-de95-4fdb-8f8f-2df237f335b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:54.253698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1939c1d-de95-4fdb-8f8f-2df237f335b6 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:54.255957 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:54.265639 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1444/2896] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:54.269471 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603c72f-44aa-4694-8331-1d522d0ebe5d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:54.280336 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603c72f-44aa-4694-8331-1d522d0ebe5d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:54.284872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139266b5-1cad-47db-90e2-39c800d4dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:54.285516 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139266b5-1cad-47db-90e2-39c800d4dab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:54.285801 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139266b5-1cad-47db-90e2-39c800d4dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:54.286076 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139266b5-1cad-47db-90e2-39c800d4dab6 admin admin] PATH_INFO: `/v3/projects/1d77e8ffbd1e44feb6cc72e7a7313d2d/users/486627ba211b4366a89d90b8273d87c4/roles/5c27a729c8e54cbfac6c0f033f9e51b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:54.288032 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139266b5-1cad-47db-90e2-39c800d4dab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d77e8ffbd1e44feb6cc72e7a7313d2d, user_id=486627ba211b4366a89d90b8273d87c4, role_id=5c27a729c8e54cbfac6c0f033f9e51b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:54.290653 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139266b5-1cad-47db-90e2-39c800d4dab6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:54.301298 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1453/2897] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:54 2022] PUT /identity/v3/projects/1d77e8ffbd1e44feb6cc72e7a7313d2d/users/486627ba211b4366a89d90b8273d87c4/roles/5c27a729c8e54cbfac6c0f033f9e51b7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:54.311659 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6437fbd-a1ac-41ab-8c59-ffab01546760 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:54.311968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6437fbd-a1ac-41ab-8c59-ffab01546760 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:54.312277 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6437fbd-a1ac-41ab-8c59-ffab01546760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:54.340624 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-a6437fbd-a1ac-41ab-8c59-ffab01546760 None None] MFA Rules not processed for user `486627ba211b4366a89d90b8273d87c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:54.341853 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-a6437fbd-a1ac-41ab-8c59-ffab01546760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:54.409257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1445/2898] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:54.419965 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139266b5-1cad-47db-90e2-39c800d4dab6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:54.421678 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-139266b5-1cad-47db-90e2-39c800d4dab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:54.452033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:54.480389 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139266b5-1cad-47db-90e2-39c800d4dab6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:54.483994 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c21deb-5abf-42a7-a6c0-2b9e27bf1a2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:54.484593 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c21deb-5abf-42a7-a6c0-2b9e27bf1a2c service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:54.484921 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c21deb-5abf-42a7-a6c0-2b9e27bf1a2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:54.485189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c21deb-5abf-42a7-a6c0-2b9e27bf1a2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:54.493779 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c21deb-5abf-42a7-a6c0-2b9e27bf1a2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:54.495239 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c21deb-5abf-42a7-a6c0-2b9e27bf1a2c service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:54.504410 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1454/2899] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:55.052611 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6437fbd-a1ac-41ab-8c59-ffab01546760 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:55.113628 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6437fbd-a1ac-41ab-8c59-ffab01546760 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:55.118184 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:55.118835 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:55.119116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:55.119391 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] PATH_INFO: `/v3/users/d1f1bec9409f43afbe6d6b46011b57a2` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:55.121091 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f1bec9409f43afbe6d6b46011b57a2)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:55.123026 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:55.167785 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f1bec9409f43afbe6d6b46011b57a2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:55.168792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f1bec9409f43afbe6d6b46011b57a2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:55.180194 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f1bec9409f43afbe6d6b46011b57a2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:55.187698 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f1bec9409f43afbe6d6b46011b57a2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:55.188334 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f1bec9409f43afbe6d6b46011b57a2'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:55.202217 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1446/2900] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:55 2022] DELETE /identity/v3/users/d1f1bec9409f43afbe6d6b46011b57a2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:55.207349 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbedb79-222c-4feb-bed3-a3d2603aaf5b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:55.207646 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbedb79-222c-4feb-bed3-a3d2603aaf5b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:55.207928 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbedb79-222c-4feb-bed3-a3d2603aaf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:55.232043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0dbedb79-222c-4feb-bed3-a3d2603aaf5b None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:55.233265 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0dbedb79-222c-4feb-bed3-a3d2603aaf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:55.294189 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1455/2901] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:55.303821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:55.305227 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:55.311713 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:55.369289 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8fb5f-4fb2-471b-a276-0f92bc0bd371 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:55.373675 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d739c-7bc8-45de-a8e8-05489f0c3911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:55.374270 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d739c-7bc8-45de-a8e8-05489f0c3911 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:55.374545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d739c-7bc8-45de-a8e8-05489f0c3911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:55.374850 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d739c-7bc8-45de-a8e8-05489f0c3911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:55.383648 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d739c-7bc8-45de-a8e8-05489f0c3911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:55.385060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d739c-7bc8-45de-a8e8-05489f0c3911 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:55.394630 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1447/2902] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:55.880296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbedb79-222c-4feb-bed3-a3d2603aaf5b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:55.881938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0dbedb79-222c-4feb-bed3-a3d2603aaf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:55.895859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbedb79-222c-4feb-bed3-a3d2603aaf5b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:55.900486 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:55.901120 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:55.901404 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:55.902266 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] PATH_INFO: `/v3/projects/1a7994c2fa3145a0ae0c2ed3ec35e12d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:55.904043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7994c2fa3145a0ae0c2ed3ec35e12d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:55.905960 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:55.952231 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7994c2fa3145a0ae0c2ed3ec35e12d', 'request_id': 'req-45b62afa-9127-4394-ab3c-bcee5195c4e3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:55.957632 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7994c2fa3145a0ae0c2ed3ec35e12d', 'request_id': 'req-45b62afa-9127-4394-ab3c-bcee5195c4e3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:55.963622 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7994c2fa3145a0ae0c2ed3ec35e12d', 'request_id': 'req-45b62afa-9127-4394-ab3c-bcee5195c4e3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:55.976088 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] The token cache is being invalidate because project 1a7994c2fa3145a0ae0c2ed3ec35e12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:55.976378 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:55.977003 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:55.978469 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1456/2903] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:55 2022] DELETE /identity/v3/projects/1a7994c2fa3145a0ae0c2ed3ec35e12d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:55.982904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d739c-7bc8-45de-a8e8-05489f0c3911 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:55.992737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d739c-7bc8-45de-a8e8-05489f0c3911 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:56.048999 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:56.049542 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.049821 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.050123 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] PATH_INFO: `/v3/users/486627ba211b4366a89d90b8273d87c4` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:56.051257 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486627ba211b4366a89d90b8273d87c4)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:56.053156 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:56.098598 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486627ba211b4366a89d90b8273d87c4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:56.099265 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486627ba211b4366a89d90b8273d87c4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:56.110775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486627ba211b4366a89d90b8273d87c4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:56.117586 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486627ba211b4366a89d90b8273d87c4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:56.118230 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-2886836d-50a8-4945-8017-e261d8602710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486627ba211b4366a89d90b8273d87c4'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:56.130626 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1448/2904] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:55 2022] DELETE /identity/v3/users/486627ba211b4366a89d90b8273d87c4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:56.397706 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:56.399245 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:56.412531 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62afa-9127-4394-ab3c-bcee5195c4e3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:56.462431 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:56.473641 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:56.474275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.474554 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.474868 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] PATH_INFO: `/v3/projects/1d77e8ffbd1e44feb6cc72e7a7313d2d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:56.475983 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d77e8ffbd1e44feb6cc72e7a7313d2d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:56.477912 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:56.523139 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d77e8ffbd1e44feb6cc72e7a7313d2d', 'request_id': 'req-b107e148-5c56-49f5-9bed-f4ce9457ed9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:56.529517 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d77e8ffbd1e44feb6cc72e7a7313d2d', 'request_id': 'req-b107e148-5c56-49f5-9bed-f4ce9457ed9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:56.535437 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d77e8ffbd1e44feb6cc72e7a7313d2d', 'request_id': 'req-b107e148-5c56-49f5-9bed-f4ce9457ed9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:56.549097 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] The token cache is being invalidate because project 1d77e8ffbd1e44feb6cc72e7a7313d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:56.549388 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:56.549993 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b107e148-5c56-49f5-9bed-f4ce9457ed9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:56.551468 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1457/2905] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:56 2022] DELETE /identity/v3/projects/1d77e8ffbd1e44feb6cc72e7a7313d2d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:56.556307 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75d530-6925-4b7e-80a4-e3ef32c9ccbd None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.556759 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75d530-6925-4b7e-80a4-e3ef32c9ccbd None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.556885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75d530-6925-4b7e-80a4-e3ef32c9ccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:56.576203 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-cd75d530-6925-4b7e-80a4-e3ef32c9ccbd None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:56.577330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-cd75d530-6925-4b7e-80a4-e3ef32c9ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:56.596247 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:56.638983 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1449/2906] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:56.646735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb704-97a8-4b95-bcb0-878e15b955e0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.647024 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb704-97a8-4b95-bcb0-878e15b955e0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.647299 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb704-97a8-4b95-bcb0-878e15b955e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:56.667128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-212eb704-97a8-4b95-bcb0-878e15b955e0 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:56.668951 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-212eb704-97a8-4b95-bcb0-878e15b955e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:56.677170 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1458/2907] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:56.681452 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75d530-6925-4b7e-80a4-e3ef32c9ccbd None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:56.691859 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75d530-6925-4b7e-80a4-e3ef32c9ccbd None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:56.696422 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdc2c7-575c-4efa-beaf-fb2855936317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:56.697016 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdc2c7-575c-4efa-beaf-fb2855936317 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.697295 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdc2c7-575c-4efa-beaf-fb2855936317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.697567 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdc2c7-575c-4efa-beaf-fb2855936317 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:56.698208 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdc2c7-575c-4efa-beaf-fb2855936317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:56.698580 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdc2c7-575c-4efa-beaf-fb2855936317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:56.700195 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdc2c7-575c-4efa-beaf-fb2855936317 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:56.711451 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1450/2908] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:56.715561 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eb704-97a8-4b95-bcb0-878e15b955e0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:56.724620 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eb704-97a8-4b95-bcb0-878e15b955e0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:56.729184 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a037d6-1ef3-4be7-8172-8e2a2d4ce1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:56.730346 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a037d6-1ef3-4be7-8172-8e2a2d4ce1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.730664 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a037d6-1ef3-4be7-8172-8e2a2d4ce1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.730943 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a037d6-1ef3-4be7-8172-8e2a2d4ce1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:56.731592 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a037d6-1ef3-4be7-8172-8e2a2d4ce1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:56.733470 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a037d6-1ef3-4be7-8172-8e2a2d4ce1c0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:56.760859 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1459/2909] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:56 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:56.765326 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdc2c7-575c-4efa-beaf-fb2855936317 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:56.775325 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdc2c7-575c-4efa-beaf-fb2855936317 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:56.830359 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3de9c3-7de5-41dc-b981-8dd785380aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:56.831144 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3de9c3-7de5-41dc-b981-8dd785380aec admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.831617 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3de9c3-7de5-41dc-b981-8dd785380aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.831931 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3de9c3-7de5-41dc-b981-8dd785380aec admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:56.832565 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3de9c3-7de5-41dc-b981-8dd785380aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:56.834469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3de9c3-7de5-41dc-b981-8dd785380aec admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:56.855715 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1451/2910] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:56 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:56.859894 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a037d6-1ef3-4be7-8172-8e2a2d4ce1c0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:56.870163 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a037d6-1ef3-4be7-8172-8e2a2d4ce1c0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:56.875533 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416bc7f-182d-47ce-9e6e-6139048f2ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:56.876110 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416bc7f-182d-47ce-9e6e-6139048f2ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.876383 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416bc7f-182d-47ce-9e6e-6139048f2ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.876650 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416bc7f-182d-47ce-9e6e-6139048f2ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:56.877275 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416bc7f-182d-47ce-9e6e-6139048f2ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:56.878905 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416bc7f-182d-47ce-9e6e-6139048f2ca6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:56.888903 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1460/2911] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:56.892764 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3de9c3-7de5-41dc-b981-8dd785380aec admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:56.903141 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3de9c3-7de5-41dc-b981-8dd785380aec admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:56.907792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6dc12-8f9e-4d79-9a33-00a6dc16b1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:56.908381 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6dc12-8f9e-4d79-9a33-00a6dc16b1be admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.908665 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6dc12-8f9e-4d79-9a33-00a6dc16b1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.909011 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6dc12-8f9e-4d79-9a33-00a6dc16b1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:56.909739 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6dc12-8f9e-4d79-9a33-00a6dc16b1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:56.911384 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6dc12-8f9e-4d79-9a33-00a6dc16b1be admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:56.922924 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1452/2912] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:56.927128 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416bc7f-182d-47ce-9e6e-6139048f2ca6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:56.937771 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416bc7f-182d-47ce-9e6e-6139048f2ca6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:56.942255 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2775da-9ac7-4999-a5cc-98c8760cee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:56.942908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2775da-9ac7-4999-a5cc-98c8760cee49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.943185 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2775da-9ac7-4999-a5cc-98c8760cee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.943453 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2775da-9ac7-4999-a5cc-98c8760cee49 admin admin] PATH_INFO: `/v3/projects/4fdc52a95d444702b0aec27f3747ceb7/users/c2927d99e6984404a475895efc832f30/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:56.957405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2775da-9ac7-4999-a5cc-98c8760cee49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdc52a95d444702b0aec27f3747ceb7, user_id=c2927d99e6984404a475895efc832f30, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:56.960074 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2775da-9ac7-4999-a5cc-98c8760cee49 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:56.973519 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1461/2913] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:56 2022] PUT /identity/v3/projects/4fdc52a95d444702b0aec27f3747ceb7/users/c2927d99e6984404a475895efc832f30/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:45:56.985215 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ba56-6311-4471-9478-0e30963dfd8a None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:56.985506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ba56-6311-4471-9478-0e30963dfd8a None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:56.985804 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ba56-6311-4471-9478-0e30963dfd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:57.015286 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dc42ba56-6311-4471-9478-0e30963dfd8a None None] MFA Rules not processed for user `c2927d99e6984404a475895efc832f30`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:57.016501 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dc42ba56-6311-4471-9478-0e30963dfd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:57.082300 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1453/2914] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:57.093498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2775da-9ac7-4999-a5cc-98c8760cee49 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:57.095217 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4c2775da-9ac7-4999-a5cc-98c8760cee49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:57.150575 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2775da-9ac7-4999-a5cc-98c8760cee49 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:57.154386 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb4149-8a66-4d43-8524-f9cae3b1e4b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:57.155019 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb4149-8a66-4d43-8524-f9cae3b1e4b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:57.155296 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb4149-8a66-4d43-8524-f9cae3b1e4b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:57.155566 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb4149-8a66-4d43-8524-f9cae3b1e4b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:57.163582 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb4149-8a66-4d43-8524-f9cae3b1e4b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:57.165007 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb4149-8a66-4d43-8524-f9cae3b1e4b3 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:57.173677 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1462/2915] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:57.193244 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42ba56-6311-4471-9478-0e30963dfd8a None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:57.213807 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:57.255486 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42ba56-6311-4471-9478-0e30963dfd8a None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:57.260019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:57.260637 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:57.261538 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:57.261915 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] PATH_INFO: `/v3/users/c2927d99e6984404a475895efc832f30` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:57.263438 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2927d99e6984404a475895efc832f30)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:57.265340 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:57.310855 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2927d99e6984404a475895efc832f30'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:57.311512 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2927d99e6984404a475895efc832f30'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:57.324410 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2927d99e6984404a475895efc832f30'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:57.331037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2927d99e6984404a475895efc832f30'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:57.331693 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2927d99e6984404a475895efc832f30'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:57.347249 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1454/2916] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:45:57 2022] DELETE /identity/v3/users/c2927d99e6984404a475895efc832f30 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:57.351998 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be90a9-a7a3-437d-baa5-67c74436533f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:57.352284 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be90a9-a7a3-437d-baa5-67c74436533f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:57.352559 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be90a9-a7a3-437d-baa5-67c74436533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:57.372585 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c7be90a9-a7a3-437d-baa5-67c74436533f None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:57.373777 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c7be90a9-a7a3-437d-baa5-67c74436533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:57.390249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:57.434148 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1463/2917] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:57.444037 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:57.445433 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:57.503545 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f212b-eee6-481d-99f1-fd8a380f13c7 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:57.507181 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc044-f991-4076-a486-028d18c131e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:57.507784 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc044-f991-4076-a486-028d18c131e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:57.508066 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc044-f991-4076-a486-028d18c131e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:57.508341 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc044-f991-4076-a486-028d18c131e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:57.518067 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efc044-f991-4076-a486-028d18c131e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:57.519590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efc044-f991-4076-a486-028d18c131e4 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:57.529288 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1455/2918] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:57.792145 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be90a9-a7a3-437d-baa5-67c74436533f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:57.794204 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c7be90a9-a7a3-437d-baa5-67c74436533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:57.806425 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be90a9-a7a3-437d-baa5-67c74436533f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:57.811361 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:57.811989 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:57.812266 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:57.812535 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] PATH_INFO: `/v3/projects/4fdc52a95d444702b0aec27f3747ceb7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:57.813633 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fdc52a95d444702b0aec27f3747ceb7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:57.815570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:57.861544 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fdc52a95d444702b0aec27f3747ceb7', 'request_id': 'req-fc26deff-3052-4a3a-a41b-25902b7b9bc0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:57.866913 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fdc52a95d444702b0aec27f3747ceb7', 'request_id': 'req-fc26deff-3052-4a3a-a41b-25902b7b9bc0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:57.872856 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fdc52a95d444702b0aec27f3747ceb7', 'request_id': 'req-fc26deff-3052-4a3a-a41b-25902b7b9bc0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:57.884452 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] The token cache is being invalidate because project 4fdc52a95d444702b0aec27f3747ceb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:45:57.884735 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:57.885360 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc26deff-3052-4a3a-a41b-25902b7b9bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:45:57.886877 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1464/2919] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:45:57 2022] DELETE /identity/v3/projects/4fdc52a95d444702b0aec27f3747ceb7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:57.892009 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde85c52-93a9-40bb-820f-3f902e62c0c5 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:57.892471 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde85c52-93a9-40bb-820f-3f902e62c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:57.892590 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde85c52-93a9-40bb-820f-3f902e62c0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:57.913530 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-dde85c52-93a9-40bb-820f-3f902e62c0c5 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:57.914748 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-dde85c52-93a9-40bb-820f-3f902e62c0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:57.951506 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:57.972541 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1456/2920] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:45:57.980781 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc21c96-9765-44e7-bd4f-af4813048894 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:57.981065 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc21c96-9765-44e7-bd4f-af4813048894 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:57.981338 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc21c96-9765-44e7-bd4f-af4813048894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:58.000492 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bbc21c96-9765-44e7-bd4f-af4813048894 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:58.001680 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bbc21c96-9765-44e7-bd4f-af4813048894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:58.009933 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1465/2921] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:58.014330 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde85c52-93a9-40bb-820f-3f902e62c0c5 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:58.023900 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde85c52-93a9-40bb-820f-3f902e62c0c5 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:58.028907 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c5b0d-1edd-48e4-9283-c7e43e24e018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:58.029498 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c5b0d-1edd-48e4-9283-c7e43e24e018 admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:58.029774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c5b0d-1edd-48e4-9283-c7e43e24e018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:58.030043 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c5b0d-1edd-48e4-9283-c7e43e24e018 admin admin] PATH_INFO: `/v3/domains` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:58.030740 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c5b0d-1edd-48e4-9283-c7e43e24e018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:58.031048 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c5b0d-1edd-48e4-9283-c7e43e24e018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:58.032631 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c5b0d-1edd-48e4-9283-c7e43e24e018 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:58.044390 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1457/2922] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Oct 4 08:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:58.048754 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc21c96-9765-44e7-bd4f-af4813048894 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:58.057742 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc21c96-9765-44e7-bd4f-af4813048894 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:58.062343 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99179639-d9c7-46f7-b41d-997511cf7965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:58.062969 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99179639-d9c7-46f7-b41d-997511cf7965 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:58.063249 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99179639-d9c7-46f7-b41d-997511cf7965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:58.063518 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99179639-d9c7-46f7-b41d-997511cf7965 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:58.064143 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99179639-d9c7-46f7-b41d-997511cf7965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:58.066023 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99179639-d9c7-46f7-b41d-997511cf7965 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:58.092698 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1466/2923] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Oct 4 08:45:58 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:58.096858 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c5b0d-1edd-48e4-9283-c7e43e24e018 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:58.107497 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c5b0d-1edd-48e4-9283-c7e43e24e018 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:58.162472 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f6c55-c8ad-4796-b881-0d4dd41a4251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:58.163030 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f6c55-c8ad-4796-b881-0d4dd41a4251 admin admin] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:58.163306 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f6c55-c8ad-4796-b881-0d4dd41a4251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:58.163573 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f6c55-c8ad-4796-b881-0d4dd41a4251 admin admin] PATH_INFO: `/v3/users` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:58.164204 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f6c55-c8ad-4796-b881-0d4dd41a4251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:58.166116 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f6c55-c8ad-4796-b881-0d4dd41a4251 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:58.187060 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1458/2924] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Oct 4 08:45:58 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:58.191144 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99179639-d9c7-46f7-b41d-997511cf7965 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:58.201768 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99179639-d9c7-46f7-b41d-997511cf7965 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:58.206283 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53c996-9d27-4d58-997d-f808b2da3850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:58.206908 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53c996-9d27-4d58-997d-f808b2da3850 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:58.207192 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53c996-9d27-4d58-997d-f808b2da3850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:58.207467 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53c996-9d27-4d58-997d-f808b2da3850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:58.208104 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53c996-9d27-4d58-997d-f808b2da3850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:58.209691 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53c996-9d27-4d58-997d-f808b2da3850 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:58.220151 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1467/2925] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:45:58.223794 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f6c55-c8ad-4796-b881-0d4dd41a4251 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:58.234253 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f6c55-c8ad-4796-b881-0d4dd41a4251 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:58.238775 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9441-0ddf-4c12-bd88-7d572c81f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:58.239358 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9441-0ddf-4c12-bd88-7d572c81f50a admin admin] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:58.239635 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9441-0ddf-4c12-bd88-7d572c81f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:58.239904 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9441-0ddf-4c12-bd88-7d572c81f50a admin admin] PATH_INFO: `/v3/roles` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:58.240535 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9441-0ddf-4c12-bd88-7d572c81f50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:58.242217 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9441-0ddf-4c12-bd88-7d572c81f50a admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:58.253058 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1459/2926] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 08:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:45:58.257091 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53c996-9d27-4d58-997d-f808b2da3850 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:58.267197 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53c996-9d27-4d58-997d-f808b2da3850 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:58.271738 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d8bf9-df34-4953-b76c-34e2e89163a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:58.272374 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8bf9-df34-4953-b76c-34e2e89163a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:58.272657 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8bf9-df34-4953-b76c-34e2e89163a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:58.272948 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8bf9-df34-4953-b76c-34e2e89163a9 admin admin] PATH_INFO: `/v3/projects/cd63ed68365f42c9b34c392a582f4d1f/users/e2e88aa62718468490f828410be38546/roles/adb2774e1d254454a97fab85c6000155` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:58.287175 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d8bf9-df34-4953-b76c-34e2e89163a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd63ed68365f42c9b34c392a582f4d1f, user_id=e2e88aa62718468490f828410be38546, role_id=adb2774e1d254454a97fab85c6000155)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:58.289839 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d8bf9-df34-4953-b76c-34e2e89163a9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:58.303384 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1468/2927] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Oct 4 08:45:58 2022] PUT /identity/v3/projects/cd63ed68365f42c9b34c392a582f4d1f/users/e2e88aa62718468490f828410be38546/roles/adb2774e1d254454a97fab85c6000155 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:58.315968 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6a36-c83b-47a4-ad0f-f98c15793703 None None] REQUEST_METHOD: `POST` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:58.316248 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6a36-c83b-47a4-ad0f-f98c15793703 None None] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:58.316518 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6a36-c83b-47a4-ad0f-f98c15793703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:58.344654 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.auth.core [None req-2bde6a36-c83b-47a4-ad0f-f98c15793703 None None] MFA Rules not processed for user `e2e88aa62718468490f828410be38546`. Rule list: `[]` (Enabled: `True`). {{(pid=81399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:58.345845 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-2bde6a36-c83b-47a4-ad0f-f98c15793703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:58.408792 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1460/2928] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:45:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:45:58.420033 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d8bf9-df34-4953-b76c-34e2e89163a9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:58.421682 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c17d8bf9-df34-4953-b76c-34e2e89163a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:58.467570 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:58.481959 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d8bf9-df34-4953-b76c-34e2e89163a9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:58.485763 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e1834-3c54-4f24-8fff-6b2f369d0545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53db39d8c5d1459294b0376d052a9495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:58.486396 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e1834-3c54-4f24-8fff-6b2f369d0545 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:58.486701 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e1834-3c54-4f24-8fff-6b2f369d0545 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:58.486968 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e1834-3c54-4f24-8fff-6b2f369d0545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:58.495043 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e1834-3c54-4f24-8fff-6b2f369d0545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:58.497182 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e1834-3c54-4f24-8fff-6b2f369d0545 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:58.505605 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1469/2929] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:46:08.406004 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:08.501805 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:09.907910 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde6a36-c83b-47a4-ad0f-f98c15793703 None None] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:09.971014 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde6a36-c83b-47a4-ad0f-f98c15793703 None None] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:09.976245 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:09.976937 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:09.977363 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:09.977774 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] PATH_INFO: `/v3/users/e2e88aa62718468490f828410be38546` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:09.978966 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e88aa62718468490f828410be38546)` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:09.981319 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:10.026500 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e88aa62718468490f828410be38546'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:46:10.027225 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e88aa62718468490f828410be38546'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:46:10.039019 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e88aa62718468490f828410be38546'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:46:10.045963 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e88aa62718468490f828410be38546'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:46:10.046597 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.notifications [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e88aa62718468490f828410be38546'} {{(pid=81399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:46:10.059888 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1461/2930] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 08:46:09 2022] DELETE /identity/v3/users/e2e88aa62718468490f828410be38546 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:46:10.064340 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d506468-ec21-4176-98d6-d9b09ade6341 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:10.064821 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d506468-ec21-4176-98d6-d9b09ade6341 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:10.064938 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d506468-ec21-4176-98d6-d9b09ade6341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:10.084016 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5d506468-ec21-4176-98d6-d9b09ade6341 None None] MFA Rules not processed for user `e9cbf2d8bf704c83aab7f97b0095bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:10.085211 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5d506468-ec21-4176-98d6-d9b09ade6341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:10.146006 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1470/2931] 10.222.0.23 () {58 vars in 958 bytes} [Tue Oct 4 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:46:10.155696 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:10.157109 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:10.213183 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d341d-35f5-4c6c-ae5f-2e614687d436 admin admin] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:10.216885 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4ca2c-631e-4a74-9633-f75cfe2543f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a186bffa7854d34b91edfa4eb4b2498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:10.217482 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4ca2c-631e-4a74-9633-f75cfe2543f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:10.217760 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4ca2c-631e-4a74-9633-f75cfe2543f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:10.218032 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4ca2c-631e-4a74-9633-f75cfe2543f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:10.226920 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4ca2c-631e-4a74-9633-f75cfe2543f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:10.228336 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4ca2c-631e-4a74-9633-f75cfe2543f8 service neutron] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:10.238112 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1462/2932] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:46:10.506542 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d506468-ec21-4176-98d6-d9b09ade6341 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:10.508077 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5d506468-ec21-4176-98d6-d9b09ade6341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:10.520462 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d506468-ec21-4176-98d6-d9b09ade6341 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:10.525454 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cbf2d8bf704c83aab7f97b0095bb79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e3a02aac0ea474388632672a0c54b89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:10.526109 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:10.526390 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:10.527232 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] PATH_INFO: `/v3/projects/cd63ed68365f42c9b34c392a582f4d1f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:10.528498 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd63ed68365f42c9b34c392a582f4d1f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:10.530405 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:10.578352 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd63ed68365f42c9b34c392a582f4d1f', 'request_id': 'req-cf4f910f-8744-421f-8188-6cdca69e4a58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:46:10.583872 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd63ed68365f42c9b34c392a582f4d1f', 'request_id': 'req-cf4f910f-8744-421f-8188-6cdca69e4a58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:46:10.595354 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd63ed68365f42c9b34c392a582f4d1f', 'request_id': 'req-cf4f910f-8744-421f-8188-6cdca69e4a58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:46:10.604623 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] The token cache is being invalidate because project cd63ed68365f42c9b34c392a582f4d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:46:10.604919 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:46:10.606337 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf4f910f-8744-421f-8188-6cdca69e4a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:46:10.608063 dv-cinder-860209-1-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1471/2933] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 08:46:10 2022] DELETE /identity/v3/projects/cd63ed68365f42c9b34c392a582f4d1f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:46:20.234041 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:20.601412 dv-cinder-860209-1-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:52.403793 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4ca2c-631e-4a74-9633-f75cfe2543f8 service neutron] Authenticating user token {{(pid=81399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:52.405207 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-90e4ca2c-631e-4a74-9633-f75cfe2543f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:52.472836 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4ca2c-631e-4a74-9633-f75cfe2543f8 service neutron] Validating token access rules against request {{(pid=81399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:52.530871 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d408fd9-31a7-4c63-8a3b-0f3dac62a1c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4030325cf0481ab634e253cfed9c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59e48b55267f4e5bb04399e6f49ad053', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:52.531469 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d408fd9-31a7-4c63-8a3b-0f3dac62a1c3 service placement] REQUEST_METHOD: `GET` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:52.531751 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d408fd9-31a7-4c63-8a3b-0f3dac62a1c3 service placement] SCRIPT_NAME: `/identity` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:52.532020 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d408fd9-31a7-4c63-8a3b-0f3dac62a1c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:52.533737 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.fernet_utils [None req-4d408fd9-31a7-4c63-8a3b-0f3dac62a1c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:52.544791 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d408fd9-31a7-4c63-8a3b-0f3dac62a1c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:52.546371 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d408fd9-31a7-4c63-8a3b-0f3dac62a1c3 service placement] RBAC: Authorization granted {{(pid=81399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:52.556133 dv-cinder-860209-1-smb devstack@keystone.service[81399]: [pid: 81399|app: 0|req: 1463/2934] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:02.551906 dv-cinder-860209-1-smb devstack@keystone.service[81399]: DEBUG dbcounter [-] [81399] Writing DB stats keystone:SELECT=58 {{(pid=81399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}